[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240503 08:11:55.745762 16425 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.10.126:45713
I20240503 08:11:55.747370 16425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 08:11:55.748631 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:11:55.759747 16433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:11:55.760237 16431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:11:55.760747 16430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:11:55.761396 16425 server_base.cc:1034] running on GCE node
I20240503 08:11:55.762255 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:11:55.762421 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:11:55.762501 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723915762481 us; error 0 us; skew 500 ppm
I20240503 08:11:55.762861 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:11:55.765597 16425 webserver.cc:460] Webserver started at http://127.16.10.126:32935/ using document root <none> and password file <none>
I20240503 08:11:55.766510 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:11:55.766619 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:11:55.766958 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:11:55.770432 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/master-0-root/instance:
uuid: "143540eeaac5475a845926273306044f"
format_stamp: "Formatted at 2024-05-03 08:11:55 on dist-test-slave-6p8x"
I20240503 08:11:55.777066 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20240503 08:11:55.780453 16438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:11:55.781981 16425 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20240503 08:11:55.782155 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/master-0-root
uuid: "143540eeaac5475a845926273306044f"
format_stamp: "Formatted at 2024-05-03 08:11:55 on dist-test-slave-6p8x"
I20240503 08:11:55.782333 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:11:55.803586 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:11:55.804453 16425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 08:11:55.804728 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:11:55.822490 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.126:45713
I20240503 08:11:55.822503 16489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.126:45713 every 8 connection(s)
I20240503 08:11:55.827015 16490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:55.839517 16490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f: Bootstrap starting.
I20240503 08:11:55.843291 16490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:55.844485 16490 log.cc:824] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f: Log is configured to *not* fsync() on all Append() calls
I20240503 08:11:55.847174 16490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f: No bootstrap required, opened a new log
I20240503 08:11:55.854247 16490 raft_consensus.cc:348] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "143540eeaac5475a845926273306044f" member_type: VOTER }
I20240503 08:11:55.854588 16490 raft_consensus.cc:374] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:55.854693 16490 raft_consensus.cc:729] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 143540eeaac5475a845926273306044f, State: Initialized, Role: FOLLOWER
I20240503 08:11:55.855485 16490 consensus_queue.cc:260] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "143540eeaac5475a845926273306044f" member_type: VOTER }
I20240503 08:11:55.855710 16490 raft_consensus.cc:388] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:11:55.855839 16490 raft_consensus.cc:482] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:11:55.856003 16490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:55.858055 16490 raft_consensus.cc:504] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "143540eeaac5475a845926273306044f" member_type: VOTER }
I20240503 08:11:55.858588 16490 leader_election.cc:302] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 143540eeaac5475a845926273306044f; no voters:
I20240503 08:11:55.859244 16490 leader_election.cc:288] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:11:55.859365 16493 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:11:55.859985 16493 raft_consensus.cc:686] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [term 1 LEADER]: Becoming Leader. State: Replica: 143540eeaac5475a845926273306044f, State: Running, Role: LEADER
I20240503 08:11:55.860576 16493 consensus_queue.cc:237] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "143540eeaac5475a845926273306044f" member_type: VOTER }
I20240503 08:11:55.861269 16490 sys_catalog.cc:564] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:11:55.863566 16494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "143540eeaac5475a845926273306044f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "143540eeaac5475a845926273306044f" member_type: VOTER } }
I20240503 08:11:55.863596 16495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 143540eeaac5475a845926273306044f. Latest consensus state: current_term: 1 leader_uuid: "143540eeaac5475a845926273306044f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "143540eeaac5475a845926273306044f" member_type: VOTER } }
I20240503 08:11:55.863902 16494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [sys.catalog]: This master's current role is: LEADER
I20240503 08:11:55.863938 16495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [sys.catalog]: This master's current role is: LEADER
I20240503 08:11:55.865814 16499 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:11:55.871089 16499 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:11:55.876356 16425 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240503 08:11:55.879984 16499 catalog_manager.cc:1347] Generated new cluster ID: 3e07af50efce4445834f65e3459aef4b
I20240503 08:11:55.880110 16499 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:11:55.894291 16499 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:11:55.896104 16499 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:11:55.907565 16499 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f: Generated new TSK 0
I20240503 08:11:55.908762 16499 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:11:55.942080 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:11:55.946591 16512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:11:55.947567 16513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:11:55.948216 16425 server_base.cc:1034] running on GCE node
W20240503 08:11:55.949102 16515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:11:55.949481 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:11:55.949573 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:11:55.949645 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723915949617 us; error 0 us; skew 500 ppm
I20240503 08:11:55.949846 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:11:55.951300 16425 webserver.cc:460] Webserver started at http://127.16.10.65:35979/ using document root <none> and password file <none>
I20240503 08:11:55.951583 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:11:55.951671 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:11:55.951835 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:11:55.952507 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-0-root/instance:
uuid: "ca07569acd3c4788a18088342811372f"
format_stamp: "Formatted at 2024-05-03 08:11:55 on dist-test-slave-6p8x"
I20240503 08:11:55.960155 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.007s
I20240503 08:11:55.962116 16520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:11:55.962507 16425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:11:55.962632 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-0-root
uuid: "ca07569acd3c4788a18088342811372f"
format_stamp: "Formatted at 2024-05-03 08:11:55 on dist-test-slave-6p8x"
I20240503 08:11:55.962775 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:11:55.990206 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:11:55.990932 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:11:55.991904 16425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:11:55.993412 16425 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:11:55.993556 16425 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:11:55.993690 16425 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:11:55.993772 16425 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:11:56.014818 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.65:42565
I20240503 08:11:56.014822 16582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.65:42565 every 8 connection(s)
I20240503 08:11:56.017028 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:11:56.033627 16585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:11:56.034682 16588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:11:56.048539 16583 heartbeater.cc:347] Connected to a master server at 127.16.10.126:45713
W20240503 08:11:56.048843 16590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:11:56.048940 16583 heartbeater.cc:464] Registering TS with master...
I20240503 08:11:56.049808 16583 heartbeater.cc:511] Master 127.16.10.126:45713 requested a full tablet report, sending...
I20240503 08:11:56.050067 16425 server_base.cc:1034] running on GCE node
I20240503 08:11:56.050401 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:11:56.050482 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:11:56.050557 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723916050518 us; error 0 us; skew 500 ppm
I20240503 08:11:56.050722 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:11:56.052191 16455 ts_manager.cc:194] Registered new tserver with Master: ca07569acd3c4788a18088342811372f (127.16.10.65:42565)
I20240503 08:11:56.053917 16455 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58472
I20240503 08:11:56.055855 16425 webserver.cc:460] Webserver started at http://127.16.10.66:45891/ using document root <none> and password file <none>
I20240503 08:11:56.056108 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:11:56.056216 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:11:56.056367 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:11:56.057196 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-1-root/instance:
uuid: "1e3692757b61436dade71922df50600d"
format_stamp: "Formatted at 2024-05-03 08:11:56 on dist-test-slave-6p8x"
I20240503 08:11:56.059988 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20240503 08:11:56.061789 16595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:11:56.062335 16425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:11:56.062450 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-1-root
uuid: "1e3692757b61436dade71922df50600d"
format_stamp: "Formatted at 2024-05-03 08:11:56 on dist-test-slave-6p8x"
I20240503 08:11:56.062584 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:11:56.095057 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:11:56.095795 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:11:56.096489 16425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:11:56.097434 16425 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:11:56.097512 16425 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:11:56.097625 16425 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:11:56.097677 16425 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:11:56.115770 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.66:41879
I20240503 08:11:56.115801 16657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.66:41879 every 8 connection(s)
I20240503 08:11:56.117565 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:11:56.122108 16661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:11:56.123479 16662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:11:56.126662 16658 heartbeater.cc:347] Connected to a master server at 127.16.10.126:45713
I20240503 08:11:56.126829 16658 heartbeater.cc:464] Registering TS with master...
I20240503 08:11:56.127355 16658 heartbeater.cc:511] Master 127.16.10.126:45713 requested a full tablet report, sending...
I20240503 08:11:56.128433 16455 ts_manager.cc:194] Registered new tserver with Master: 1e3692757b61436dade71922df50600d (127.16.10.66:41879)
I20240503 08:11:56.129503 16455 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58484
I20240503 08:11:56.132161 16425 server_base.cc:1034] running on GCE node
W20240503 08:11:56.132447 16664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:11:56.132833 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:11:56.132933 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:11:56.132989 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723916132968 us; error 0 us; skew 500 ppm
I20240503 08:11:56.133179 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:11:56.134580 16425 webserver.cc:460] Webserver started at http://127.16.10.67:43733/ using document root <none> and password file <none>
I20240503 08:11:56.134826 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:11:56.134922 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:11:56.135082 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:11:56.135818 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-2-root/instance:
uuid: "adf2731df95a4745b333c70360f1df6b"
format_stamp: "Formatted at 2024-05-03 08:11:56 on dist-test-slave-6p8x"
I20240503 08:11:56.138509 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240503 08:11:56.140430 16669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:11:56.140830 16425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:11:56.140954 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-2-root
uuid: "adf2731df95a4745b333c70360f1df6b"
format_stamp: "Formatted at 2024-05-03 08:11:56 on dist-test-slave-6p8x"
I20240503 08:11:56.141077 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714723915676718-16425-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:11:56.154212 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:11:56.154834 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:11:56.155504 16425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:11:56.156513 16425 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:11:56.156612 16425 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:11:56.156706 16425 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:11:56.156785 16425 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:11:56.176115 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.67:42339
I20240503 08:11:56.176131 16731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.67:42339 every 8 connection(s)
I20240503 08:11:56.184653 16732 heartbeater.cc:347] Connected to a master server at 127.16.10.126:45713
I20240503 08:11:56.184810 16732 heartbeater.cc:464] Registering TS with master...
I20240503 08:11:56.185321 16732 heartbeater.cc:511] Master 127.16.10.126:45713 requested a full tablet report, sending...
I20240503 08:11:56.186327 16455 ts_manager.cc:194] Registered new tserver with Master: adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.186476 16425 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.009262031s
I20240503 08:11:56.187489 16455 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58486
I20240503 08:11:56.187840 16425 test_util.cc:268] Using random seed: 1172932765
I20240503 08:11:56.210991 16455 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58498:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240503 08:11:56.213286 16455 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240503 08:11:56.278111 16696 tablet_service.cc:1467] Processing CreateTablet for tablet b33015a162854ad2bf6cda67ddbb0ca5 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240503 08:11:56.278610 16693 tablet_service.cc:1467] Processing CreateTablet for tablet 8156ff16f224413a8aebdc1953ade4fd (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240503 08:11:56.279186 16696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b33015a162854ad2bf6cda67ddbb0ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.279292 16692 tablet_service.cc:1467] Processing CreateTablet for tablet 1aa154e4ac484d529b758e3dd496ecd4 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240503 08:11:56.280050 16694 tablet_service.cc:1467] Processing CreateTablet for tablet f8d9bcc6ca914e379a077bd28ce52b27 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240503 08:11:56.281002 16691 tablet_service.cc:1467] Processing CreateTablet for tablet 7581750b4e9741e9834dbd3db34ef33b (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240503 08:11:56.281742 16689 tablet_service.cc:1467] Processing CreateTablet for tablet d6353a8d0f274677b6b476eedc789f6f (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240503 08:11:56.282727 16690 tablet_service.cc:1467] Processing CreateTablet for tablet 59ae9bb05e914e07be3ab9a3d7003b38 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240503 08:11:56.283191 16697 tablet_service.cc:1467] Processing CreateTablet for tablet 3f4e21092f9746209444c8f5b7f5964d (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240503 08:11:56.278126 16695 tablet_service.cc:1467] Processing CreateTablet for tablet 19cfbee898db4fd8acf071dd2dc16bc9 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240503 08:11:56.283975 16692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aa154e4ac484d529b758e3dd496ecd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.284374 16691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7581750b4e9741e9834dbd3db34ef33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.287060 16689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6353a8d0f274677b6b476eedc789f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.291761 16690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59ae9bb05e914e07be3ab9a3d7003b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.293238 16747 tablet_bootstrap.cc:492] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b: Bootstrap starting.
I20240503 08:11:56.294970 16747 tablet_bootstrap.cc:654] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.295651 16694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8d9bcc6ca914e379a077bd28ce52b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.295903 16693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8156ff16f224413a8aebdc1953ade4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.299762 16695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19cfbee898db4fd8acf071dd2dc16bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.303702 16697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f4e21092f9746209444c8f5b7f5964d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.305192 16747 tablet_bootstrap.cc:492] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b: No bootstrap required, opened a new log
I20240503 08:11:56.305390 16747 ts_tablet_manager.cc:1367] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20240503 08:11:56.306381 16747 raft_consensus.cc:348] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.306670 16747 raft_consensus.cc:374] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.306774 16747 raft_consensus.cc:729] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.307140 16747 consensus_queue.cc:260] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.312734 16623 tablet_service.cc:1467] Processing CreateTablet for tablet 3f4e21092f9746209444c8f5b7f5964d (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240503 08:11:56.313095 16747 ts_tablet_manager.cc:1398] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20240503 08:11:56.313335 16623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f4e21092f9746209444c8f5b7f5964d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.313495 16732 heartbeater.cc:503] Master 127.16.10.126:45713 was elected leader, sending a full tablet report...
I20240503 08:11:56.320173 16622 tablet_service.cc:1467] Processing CreateTablet for tablet b33015a162854ad2bf6cda67ddbb0ca5 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240503 08:11:56.320212 16621 tablet_service.cc:1467] Processing CreateTablet for tablet 19cfbee898db4fd8acf071dd2dc16bc9 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240503 08:11:56.320736 16622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b33015a162854ad2bf6cda67ddbb0ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.321206 16619 tablet_service.cc:1467] Processing CreateTablet for tablet 8156ff16f224413a8aebdc1953ade4fd (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240503 08:11:56.321692 16619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8156ff16f224413a8aebdc1953ade4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.322237 16747 tablet_bootstrap.cc:492] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b: Bootstrap starting.
I20240503 08:11:56.322985 16750 tablet_bootstrap.cc:492] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d: Bootstrap starting.
I20240503 08:11:56.323909 16620 tablet_service.cc:1467] Processing CreateTablet for tablet f8d9bcc6ca914e379a077bd28ce52b27 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240503 08:11:56.324195 16747 tablet_bootstrap.cc:654] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.324410 16620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8d9bcc6ca914e379a077bd28ce52b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.324976 16750 tablet_bootstrap.cc:654] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.327291 16750 tablet_bootstrap.cc:492] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d: No bootstrap required, opened a new log
I20240503 08:11:56.327436 16750 ts_tablet_manager.cc:1367] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240503 08:11:56.327700 16621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19cfbee898db4fd8acf071dd2dc16bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.328042 16623 tablet_service.cc:1467] Processing CreateTablet for tablet 1aa154e4ac484d529b758e3dd496ecd4 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240503 08:11:56.328433 16623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aa154e4ac484d529b758e3dd496ecd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.328315 16750 raft_consensus.cc:348] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.328539 16750 raft_consensus.cc:374] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.328646 16750 raft_consensus.cc:729] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.328934 16750 consensus_queue.cc:260] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.329432 16747 tablet_bootstrap.cc:492] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b: No bootstrap required, opened a new log
I20240503 08:11:56.329592 16747 ts_tablet_manager.cc:1367] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20240503 08:11:56.330374 16747 raft_consensus.cc:348] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.330559 16747 raft_consensus.cc:374] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.330628 16747 raft_consensus.cc:729] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.330922 16747 consensus_queue.cc:260] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.333792 16747 ts_tablet_manager.cc:1398] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:11:56.334893 16618 tablet_service.cc:1467] Processing CreateTablet for tablet 59ae9bb05e914e07be3ab9a3d7003b38 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240503 08:11:56.334981 16617 tablet_service.cc:1467] Processing CreateTablet for tablet d6353a8d0f274677b6b476eedc789f6f (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240503 08:11:56.335448 16618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59ae9bb05e914e07be3ab9a3d7003b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.336272 16747 tablet_bootstrap.cc:492] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b: Bootstrap starting.
I20240503 08:11:56.336566 16623 tablet_service.cc:1467] Processing CreateTablet for tablet 7581750b4e9741e9834dbd3db34ef33b (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240503 08:11:56.337136 16750 ts_tablet_manager.cc:1398] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d: Time spent starting tablet: real 0.010s user 0.000s sys 0.007s
I20240503 08:11:56.337327 16658 heartbeater.cc:503] Master 127.16.10.126:45713 was elected leader, sending a full tablet report...
I20240503 08:11:56.337602 16548 tablet_service.cc:1467] Processing CreateTablet for tablet 3f4e21092f9746209444c8f5b7f5964d (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240503 08:11:56.338058 16548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f4e21092f9746209444c8f5b7f5964d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.338189 16547 tablet_service.cc:1467] Processing CreateTablet for tablet b33015a162854ad2bf6cda67ddbb0ca5 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240503 08:11:56.338755 16547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b33015a162854ad2bf6cda67ddbb0ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.339980 16623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7581750b4e9741e9834dbd3db34ef33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.341101 16545 tablet_service.cc:1467] Processing CreateTablet for tablet f8d9bcc6ca914e379a077bd28ce52b27 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240503 08:11:56.341424 16546 tablet_service.cc:1467] Processing CreateTablet for tablet 19cfbee898db4fd8acf071dd2dc16bc9 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240503 08:11:56.341591 16545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8d9bcc6ca914e379a077bd28ce52b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.341747 16750 tablet_bootstrap.cc:492] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d: Bootstrap starting.
I20240503 08:11:56.341812 16617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6353a8d0f274677b6b476eedc789f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.341974 16546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19cfbee898db4fd8acf071dd2dc16bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.342558 16543 tablet_service.cc:1467] Processing CreateTablet for tablet 1aa154e4ac484d529b758e3dd496ecd4 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240503 08:11:56.343073 16543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1aa154e4ac484d529b758e3dd496ecd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.343765 16750 tablet_bootstrap.cc:654] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.343942 16544 tablet_service.cc:1467] Processing CreateTablet for tablet 8156ff16f224413a8aebdc1953ade4fd (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240503 08:11:56.344455 16544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8156ff16f224413a8aebdc1953ade4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.346848 16541 tablet_service.cc:1467] Processing CreateTablet for tablet 59ae9bb05e914e07be3ab9a3d7003b38 (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240503 08:11:56.347333 16541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59ae9bb05e914e07be3ab9a3d7003b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.347981 16542 tablet_service.cc:1467] Processing CreateTablet for tablet 7581750b4e9741e9834dbd3db34ef33b (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240503 08:11:56.348508 16542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7581750b4e9741e9834dbd3db34ef33b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.351943 16540 tablet_service.cc:1467] Processing CreateTablet for tablet d6353a8d0f274677b6b476eedc789f6f (DEFAULT_TABLE table=test-workload [id=ec106372d50a474ead1328052e87021d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240503 08:11:56.352294 16750 tablet_bootstrap.cc:492] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d: No bootstrap required, opened a new log
I20240503 08:11:56.352437 16540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6353a8d0f274677b6b476eedc789f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:11:56.352481 16750 ts_tablet_manager.cc:1367] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20240503 08:11:56.364777 16755 tablet_bootstrap.cc:492] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f: Bootstrap starting.
I20240503 08:11:56.366549 16750 raft_consensus.cc:348] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.367167 16750 raft_consensus.cc:374] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20240503 08:11:56.367655 16659 tablet.cc:2369] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240503 08:11:56.368078 16750 raft_consensus.cc:729] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.368937 16747 tablet_bootstrap.cc:654] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.370299 16750 consensus_queue.cc:260] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.370769 16750 ts_tablet_manager.cc:1398] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d: Time spent starting tablet: real 0.018s user 0.001s sys 0.002s
I20240503 08:11:56.371165 16750 tablet_bootstrap.cc:492] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d: Bootstrap starting.
I20240503 08:11:56.377823 16750 tablet_bootstrap.cc:654] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.378214 16755 tablet_bootstrap.cc:654] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.381729 16755 tablet_bootstrap.cc:492] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f: No bootstrap required, opened a new log
I20240503 08:11:56.381913 16755 ts_tablet_manager.cc:1367] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.002s
I20240503 08:11:56.382757 16755 raft_consensus.cc:348] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.382999 16755 raft_consensus.cc:374] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.383108 16755 raft_consensus.cc:729] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.383453 16755 consensus_queue.cc:260] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.385212 16750 tablet_bootstrap.cc:492] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d: No bootstrap required, opened a new log
I20240503 08:11:56.385406 16750 ts_tablet_manager.cc:1367] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.000s
I20240503 08:11:56.386411 16747 tablet_bootstrap.cc:492] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b: No bootstrap required, opened a new log
I20240503 08:11:56.386358 16750 raft_consensus.cc:348] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.386590 16750 raft_consensus.cc:374] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.386704 16750 raft_consensus.cc:729] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.386755 16747 ts_tablet_manager.cc:1367] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.008s
I20240503 08:11:56.387128 16755 ts_tablet_manager.cc:1398] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20240503 08:11:56.387037 16750 consensus_queue.cc:260] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.387511 16583 heartbeater.cc:503] Master 127.16.10.126:45713 was elected leader, sending a full tablet report...
I20240503 08:11:56.387607 16755 tablet_bootstrap.cc:492] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f: Bootstrap starting.
I20240503 08:11:56.387988 16750 ts_tablet_manager.cc:1398] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 08:11:56.388257 16750 tablet_bootstrap.cc:492] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d: Bootstrap starting.
I20240503 08:11:56.390110 16747 raft_consensus.cc:348] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.390704 16747 raft_consensus.cc:374] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.390869 16747 raft_consensus.cc:729] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.391278 16747 consensus_queue.cc:260] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.392051 16747 ts_tablet_manager.cc:1398] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240503 08:11:56.393772 16747 tablet_bootstrap.cc:492] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b: Bootstrap starting.
I20240503 08:11:56.394112 16750 tablet_bootstrap.cc:654] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.395102 16755 tablet_bootstrap.cc:654] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.395658 16747 tablet_bootstrap.cc:654] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.399084 16755 tablet_bootstrap.cc:492] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f: No bootstrap required, opened a new log
I20240503 08:11:56.399268 16755 ts_tablet_manager.cc:1367] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20240503 08:11:56.400173 16755 raft_consensus.cc:348] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.400425 16755 raft_consensus.cc:374] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.400506 16755 raft_consensus.cc:729] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.400763 16755 consensus_queue.cc:260] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.401336 16755 ts_tablet_manager.cc:1398] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:11:56.401619 16755 tablet_bootstrap.cc:492] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f: Bootstrap starting.
I20240503 08:11:56.403311 16755 tablet_bootstrap.cc:654] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.405409 16750 tablet_bootstrap.cc:492] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d: No bootstrap required, opened a new log
I20240503 08:11:56.405576 16750 ts_tablet_manager.cc:1367] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.001s
I20240503 08:11:56.405949 16747 tablet_bootstrap.cc:492] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b: No bootstrap required, opened a new log
I20240503 08:11:56.406102 16747 ts_tablet_manager.cc:1367] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.003s
I20240503 08:11:56.406311 16750 raft_consensus.cc:348] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.406525 16750 raft_consensus.cc:374] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.406602 16750 raft_consensus.cc:729] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.406708 16747 raft_consensus.cc:348] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.406894 16747 raft_consensus.cc:374] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.406987 16747 raft_consensus.cc:729] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.406944 16750 consensus_queue.cc:260] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.407258 16747 consensus_queue.cc:260] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.407778 16747 ts_tablet_manager.cc:1398] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:11:56.408078 16747 tablet_bootstrap.cc:492] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b: Bootstrap starting.
I20240503 08:11:56.408669 16750 ts_tablet_manager.cc:1398] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240503 08:11:56.408959 16750 tablet_bootstrap.cc:492] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d: Bootstrap starting.
I20240503 08:11:56.409796 16747 tablet_bootstrap.cc:654] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.411168 16755 tablet_bootstrap.cc:492] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f: No bootstrap required, opened a new log
I20240503 08:11:56.411310 16755 ts_tablet_manager.cc:1367] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20240503 08:11:56.412109 16755 raft_consensus.cc:348] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.412308 16755 raft_consensus.cc:374] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.412417 16755 raft_consensus.cc:729] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.412479 16750 tablet_bootstrap.cc:654] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.412652 16755 consensus_queue.cc:260] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.413199 16755 ts_tablet_manager.cc:1398] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:11:56.413738 16755 tablet_bootstrap.cc:492] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f: Bootstrap starting.
I20240503 08:11:56.415436 16755 tablet_bootstrap.cc:654] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.418087 16747 tablet_bootstrap.cc:492] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b: No bootstrap required, opened a new log
I20240503 08:11:56.418157 16750 tablet_bootstrap.cc:492] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d: No bootstrap required, opened a new log
I20240503 08:11:56.418252 16747 ts_tablet_manager.cc:1367] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20240503 08:11:56.418287 16750 ts_tablet_manager.cc:1367] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20240503 08:11:56.418928 16750 raft_consensus.cc:348] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.419108 16750 raft_consensus.cc:374] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.419248 16750 raft_consensus.cc:729] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.419107 16747 raft_consensus.cc:348] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.419426 16747 raft_consensus.cc:374] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.419548 16747 raft_consensus.cc:729] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.419546 16750 consensus_queue.cc:260] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.419801 16747 consensus_queue.cc:260] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.420166 16750 ts_tablet_manager.cc:1398] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:11:56.420454 16747 ts_tablet_manager.cc:1398] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240503 08:11:56.420753 16747 tablet_bootstrap.cc:492] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b: Bootstrap starting.
I20240503 08:11:56.421097 16755 tablet_bootstrap.cc:492] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f: No bootstrap required, opened a new log
I20240503 08:11:56.421303 16755 ts_tablet_manager.cc:1367] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20240503 08:11:56.422068 16755 raft_consensus.cc:348] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.422345 16755 raft_consensus.cc:374] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.422439 16747 tablet_bootstrap.cc:654] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.422528 16755 raft_consensus.cc:729] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.422897 16755 consensus_queue.cc:260] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.423997 16750 tablet_bootstrap.cc:492] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d: Bootstrap starting.
I20240503 08:11:56.425294 16750 tablet_bootstrap.cc:654] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.425789 16755 ts_tablet_manager.cc:1398] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:11:56.426613 16755 tablet_bootstrap.cc:492] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f: Bootstrap starting.
I20240503 08:11:56.427121 16750 tablet_bootstrap.cc:492] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d: No bootstrap required, opened a new log
I20240503 08:11:56.427297 16750 ts_tablet_manager.cc:1367] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240503 08:11:56.428161 16750 raft_consensus.cc:348] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.428366 16750 raft_consensus.cc:374] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.428442 16750 raft_consensus.cc:729] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.428697 16755 tablet_bootstrap.cc:654] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.428689 16750 consensus_queue.cc:260] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.429214 16750 ts_tablet_manager.cc:1398] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:11:56.429507 16750 tablet_bootstrap.cc:492] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d: Bootstrap starting.
I20240503 08:11:56.430382 16747 tablet_bootstrap.cc:492] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b: No bootstrap required, opened a new log
I20240503 08:11:56.430598 16747 ts_tablet_manager.cc:1367] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20240503 08:11:56.431155 16750 tablet_bootstrap.cc:654] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.431483 16747 raft_consensus.cc:348] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.431753 16747 raft_consensus.cc:374] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.431902 16747 raft_consensus.cc:729] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.432224 16747 consensus_queue.cc:260] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.433300 16747 ts_tablet_manager.cc:1398] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:11:56.433573 16747 tablet_bootstrap.cc:492] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b: Bootstrap starting.
I20240503 08:11:56.434866 16747 tablet_bootstrap.cc:654] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.434929 16750 tablet_bootstrap.cc:492] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d: No bootstrap required, opened a new log
I20240503 08:11:56.435091 16750 ts_tablet_manager.cc:1367] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20240503 08:11:56.435978 16750 raft_consensus.cc:348] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.436184 16750 raft_consensus.cc:374] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.436272 16750 raft_consensus.cc:729] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.436511 16750 consensus_queue.cc:260] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.437027 16750 ts_tablet_manager.cc:1398] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:11:56.437327 16750 tablet_bootstrap.cc:492] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d: Bootstrap starting.
I20240503 08:11:56.437630 16755 tablet_bootstrap.cc:492] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f: No bootstrap required, opened a new log
I20240503 08:11:56.437775 16755 ts_tablet_manager.cc:1367] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20240503 08:11:56.438500 16755 raft_consensus.cc:348] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.438694 16755 raft_consensus.cc:374] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.438835 16750 tablet_bootstrap.cc:654] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.438810 16755 raft_consensus.cc:729] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.439039 16755 consensus_queue.cc:260] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.439596 16755 ts_tablet_manager.cc:1398] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:11:56.439858 16755 tablet_bootstrap.cc:492] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f: Bootstrap starting.
I20240503 08:11:56.440065 16749 raft_consensus.cc:482] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:11:56.440213 16749 raft_consensus.cc:504] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.441498 16755 tablet_bootstrap.cc:654] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.442124 16749 leader_election.cc:288] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), 1e3692757b61436dade71922df50600d (127.16.10.66:41879)
I20240503 08:11:56.450336 16750 tablet_bootstrap.cc:492] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d: No bootstrap required, opened a new log
I20240503 08:11:56.450520 16750 ts_tablet_manager.cc:1367] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.002s
I20240503 08:11:56.451330 16750 raft_consensus.cc:348] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.451596 16750 raft_consensus.cc:374] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.451679 16750 raft_consensus.cc:729] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.451972 16750 consensus_queue.cc:260] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.452500 16750 ts_tablet_manager.cc:1398] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:11:56.454345 16750 tablet_bootstrap.cc:492] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d: Bootstrap starting.
I20240503 08:11:56.454130 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f" is_pre_election: true
I20240503 08:11:56.454533 16755 tablet_bootstrap.cc:492] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f: No bootstrap required, opened a new log
I20240503 08:11:56.454638 16558 raft_consensus.cc:2454] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 0.
I20240503 08:11:56.454677 16755 ts_tablet_manager.cc:1367] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.013s
I20240503 08:11:56.455271 16670 leader_election.cc:302] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf2731df95a4745b333c70360f1df6b, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:56.455497 16755 raft_consensus.cc:348] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.455703 16755 raft_consensus.cc:374] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.455811 16755 raft_consensus.cc:729] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.455927 16747 tablet_bootstrap.cc:492] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b: No bootstrap required, opened a new log
I20240503 08:11:56.456100 16747 ts_tablet_manager.cc:1367] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.004s
I20240503 08:11:56.456104 16750 tablet_bootstrap.cc:654] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.456128 16755 consensus_queue.cc:260] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.456671 16755 ts_tablet_manager.cc:1398] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:11:56.456954 16755 tablet_bootstrap.cc:492] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f: Bootstrap starting.
I20240503 08:11:56.457017 16747 raft_consensus.cc:348] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.457216 16749 raft_consensus.cc:2781] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:11:56.457337 16749 raft_consensus.cc:482] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:11:56.457450 16749 raft_consensus.cc:3037] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.458576 16755 tablet_bootstrap.cc:654] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.457208 16747 raft_consensus.cc:374] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.459267 16747 raft_consensus.cc:729] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.459551 16747 consensus_queue.cc:260] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.462793 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3692757b61436dade71922df50600d" is_pre_election: true
I20240503 08:11:56.463280 16749 raft_consensus.cc:504] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.464144 16749 leader_election.cc:288] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), 1e3692757b61436dade71922df50600d (127.16.10.66:41879)
W20240503 08:11:56.464156 16670 leader_election.cc:341] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e3692757b61436dade71922df50600d (127.16.10.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:11:56.466358 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:11:56.466420 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:11:56.466620 16558 raft_consensus.cc:3037] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Advancing to term 1
W20240503 08:11:56.466873 16670 leader_election.cc:341] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e3692757b61436dade71922df50600d (127.16.10.66:41879): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:11:56.470041 16558 raft_consensus.cc:2454] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 1.
I20240503 08:11:56.470461 16670 leader_election.cc:302] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adf2731df95a4745b333c70360f1df6b, ca07569acd3c4788a18088342811372f; no voters: 1e3692757b61436dade71922df50600d
I20240503 08:11:56.470986 16749 raft_consensus.cc:2781] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:11:56.471132 16749 raft_consensus.cc:686] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Becoming Leader. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:11:56.471489 16749 consensus_queue.cc:237] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.473620 16755 tablet_bootstrap.cc:492] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f: No bootstrap required, opened a new log
I20240503 08:11:56.473856 16755 ts_tablet_manager.cc:1367] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.007s
I20240503 08:11:56.474170 16750 tablet_bootstrap.cc:492] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d: No bootstrap required, opened a new log
I20240503 08:11:56.474326 16750 ts_tablet_manager.cc:1367] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.004s
I20240503 08:11:56.474936 16755 raft_consensus.cc:348] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.475000 16750 raft_consensus.cc:348] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.475158 16755 raft_consensus.cc:374] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.475261 16755 raft_consensus.cc:729] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.475162 16750 raft_consensus.cc:374] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.475446 16750 raft_consensus.cc:729] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.475508 16755 consensus_queue.cc:260] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.475690 16750 consensus_queue.cc:260] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.476040 16755 ts_tablet_manager.cc:1398] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:11:56.476148 16750 ts_tablet_manager.cc:1398] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:11:56.476858 16755 tablet_bootstrap.cc:492] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f: Bootstrap starting.
I20240503 08:11:56.477258 16747 ts_tablet_manager.cc:1398] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b: Time spent starting tablet: real 0.021s user 0.012s sys 0.006s
I20240503 08:11:56.477576 16747 tablet_bootstrap.cc:492] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b: Bootstrap starting.
I20240503 08:11:56.478147 16455 catalog_manager.cc:5484] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b reported cstate change: term changed from 0 to 1, leader changed from <none> to adf2731df95a4745b333c70360f1df6b (127.16.10.67). New cstate: current_term: 1 leader_uuid: "adf2731df95a4745b333c70360f1df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: HEALTHY } } }
I20240503 08:11:56.478988 16755 tablet_bootstrap.cc:654] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.479602 16747 tablet_bootstrap.cc:654] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.482129 16753 raft_consensus.cc:482] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:11:56.482287 16753 raft_consensus.cc:504] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.483361 16753 leader_election.cc:288] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.490664 16755 tablet_bootstrap.cc:492] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f: No bootstrap required, opened a new log
I20240503 08:11:56.490893 16755 ts_tablet_manager.cc:1367] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.000s
I20240503 08:11:56.491571 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1aa154e4ac484d529b758e3dd496ecd4" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b" is_pre_election: true
I20240503 08:11:56.491915 16747 tablet_bootstrap.cc:492] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b: No bootstrap required, opened a new log
I20240503 08:11:56.491950 16707 raft_consensus.cc:2454] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 0.
I20240503 08:11:56.492223 16747 ts_tablet_manager.cc:1367] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.009s
I20240503 08:11:56.492522 16598 leader_election.cc:302] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, adf2731df95a4745b333c70360f1df6b; no voters:
I20240503 08:11:56.492848 16753 raft_consensus.cc:2781] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:11:56.492746 16755 raft_consensus.cc:348] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.493073 16753 raft_consensus.cc:482] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:11:56.493124 16755 raft_consensus.cc:374] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.493196 16753 raft_consensus.cc:3037] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.493237 16755 raft_consensus.cc:729] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.493492 16755 consensus_queue.cc:260] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.494079 16755 ts_tablet_manager.cc:1398] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:11:56.494074 16747 raft_consensus.cc:348] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.494514 16755 tablet_bootstrap.cc:492] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f: Bootstrap starting.
I20240503 08:11:56.494686 16747 raft_consensus.cc:374] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.494855 16747 raft_consensus.cc:729] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.495139 16747 consensus_queue.cc:260] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.495709 16747 ts_tablet_manager.cc:1398] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240503 08:11:56.496407 16755 tablet_bootstrap.cc:654] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.496513 16753 raft_consensus.cc:504] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.497354 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1aa154e4ac484d529b758e3dd496ecd4" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f" is_pre_election: true
I20240503 08:11:56.497579 16558 raft_consensus.cc:2454] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 0.
I20240503 08:11:56.498243 16747 tablet_bootstrap.cc:492] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b: Bootstrap starting.
I20240503 08:11:56.499066 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1aa154e4ac484d529b758e3dd496ecd4" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:11:56.499308 16558 raft_consensus.cc:3037] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.499979 16747 tablet_bootstrap.cc:654] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b: Neither blocks nor log segments found. Creating new log.
I20240503 08:11:56.499925 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1aa154e4ac484d529b758e3dd496ecd4" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:11:56.500104 16707 raft_consensus.cc:3037] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.502543 16558 raft_consensus.cc:2454] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 1.
I20240503 08:11:56.503109 16707 raft_consensus.cc:2454] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 1.
I20240503 08:11:56.503580 16598 leader_election.cc:302] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, adf2731df95a4745b333c70360f1df6b; no voters:
I20240503 08:11:56.504338 16755 tablet_bootstrap.cc:492] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f: No bootstrap required, opened a new log
I20240503 08:11:56.504470 16755 ts_tablet_manager.cc:1367] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20240503 08:11:56.505101 16755 raft_consensus.cc:348] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.505251 16755 raft_consensus.cc:374] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.505300 16753 leader_election.cc:288] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.505352 16755 raft_consensus.cc:729] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.505537 16753 raft_consensus.cc:2781] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:11:56.505669 16753 raft_consensus.cc:686] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Becoming Leader. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:11:56.505595 16755 consensus_queue.cc:260] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.505978 16753 consensus_queue.cc:237] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.506261 16755 ts_tablet_manager.cc:1398] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:11:56.512674 16747 tablet_bootstrap.cc:492] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b: No bootstrap required, opened a new log
I20240503 08:11:56.512815 16747 ts_tablet_manager.cc:1367] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.010s
I20240503 08:11:56.512631 16454 catalog_manager.cc:5484] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e3692757b61436dade71922df50600d (127.16.10.66). New cstate: current_term: 1 leader_uuid: "1e3692757b61436dade71922df50600d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:11:56.513466 16747 raft_consensus.cc:348] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.513615 16747 raft_consensus.cc:374] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:11:56.513710 16747 raft_consensus.cc:729] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Initialized, Role: FOLLOWER
I20240503 08:11:56.513936 16747 consensus_queue.cc:260] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.514482 16747 ts_tablet_manager.cc:1398] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:11:56.524016 16784 raft_consensus.cc:482] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:11:56.524175 16784 raft_consensus.cc:504] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.524824 16784 leader_election.cc:288] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.525240 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6353a8d0f274677b6b476eedc789f6f" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f" is_pre_election: true
I20240503 08:11:56.525240 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6353a8d0f274677b6b476eedc789f6f" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b" is_pre_election: true
I20240503 08:11:56.525432 16558 raft_consensus.cc:2454] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 0.
I20240503 08:11:56.525478 16707 raft_consensus.cc:2454] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 0.
I20240503 08:11:56.525779 16596 leader_election.cc:302] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:56.526013 16784 raft_consensus.cc:2781] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:11:56.526101 16784 raft_consensus.cc:482] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:11:56.526180 16784 raft_consensus.cc:3037] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.527262 16753 raft_consensus.cc:482] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:11:56.527396 16753 raft_consensus.cc:504] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.527884 16753 leader_election.cc:288] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.528225 16784 raft_consensus.cc:504] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.528272 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f4e21092f9746209444c8f5b7f5964d" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f" is_pre_election: true
I20240503 08:11:56.528271 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f4e21092f9746209444c8f5b7f5964d" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b" is_pre_election: true
I20240503 08:11:56.528525 16558 raft_consensus.cc:2454] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 0.
I20240503 08:11:56.528528 16707 raft_consensus.cc:2454] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 0.
I20240503 08:11:56.528795 16784 leader_election.cc:288] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.528971 16596 leader_election.cc:302] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:56.529109 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6353a8d0f274677b6b476eedc789f6f" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:11:56.529229 16784 raft_consensus.cc:2781] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:11:56.529289 16707 raft_consensus.cc:3037] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.529336 16784 raft_consensus.cc:482] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:11:56.529451 16784 raft_consensus.cc:3037] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.529479 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6353a8d0f274677b6b476eedc789f6f" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:11:56.529644 16558 raft_consensus.cc:3037] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.531438 16707 raft_consensus.cc:2454] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 1.
I20240503 08:11:56.532012 16598 leader_election.cc:302] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, adf2731df95a4745b333c70360f1df6b; no voters:
I20240503 08:11:56.532243 16753 raft_consensus.cc:2781] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:11:56.532456 16558 raft_consensus.cc:2454] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 1.
I20240503 08:11:56.532660 16753 raft_consensus.cc:686] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Becoming Leader. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:11:56.532944 16753 consensus_queue.cc:237] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.534140 16784 raft_consensus.cc:504] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.534668 16784 leader_election.cc:288] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.535120 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f4e21092f9746209444c8f5b7f5964d" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:11:56.535262 16707 raft_consensus.cc:3037] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.535589 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f4e21092f9746209444c8f5b7f5964d" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:11:56.535809 16558 raft_consensus.cc:3037] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.535567 16453 catalog_manager.cc:5484] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e3692757b61436dade71922df50600d (127.16.10.66). New cstate: current_term: 1 leader_uuid: "1e3692757b61436dade71922df50600d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:11:56.538094 16707 raft_consensus.cc:2454] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 1.
I20240503 08:11:56.538470 16598 leader_election.cc:302] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, adf2731df95a4745b333c70360f1df6b; no voters:
I20240503 08:11:56.538466 16558 raft_consensus.cc:2454] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 1.
I20240503 08:11:56.538762 16784 raft_consensus.cc:2781] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:11:56.538923 16784 raft_consensus.cc:686] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Becoming Leader. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:11:56.539156 16784 consensus_queue.cc:237] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.541424 16453 catalog_manager.cc:5484] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e3692757b61436dade71922df50600d (127.16.10.66). New cstate: current_term: 1 leader_uuid: "1e3692757b61436dade71922df50600d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:11:56.548578 16759 raft_consensus.cc:482] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:11:56.548709 16759 raft_consensus.cc:504] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.549423 16759 leader_election.cc:288] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e3692757b61436dade71922df50600d (127.16.10.66:41879), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.555788 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b" is_pre_election: true
I20240503 08:11:56.556005 16707 raft_consensus.cc:2454] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 0.
I20240503 08:11:56.556095 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3692757b61436dade71922df50600d" is_pre_election: true
I20240503 08:11:56.556295 16633 raft_consensus.cc:2454] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 0.
I20240503 08:11:56.556571 16523 leader_election.cc:302] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf2731df95a4745b333c70360f1df6b, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:56.556807 16759 raft_consensus.cc:2781] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:11:56.556891 16759 raft_consensus.cc:482] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:11:56.556949 16759 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.558723 16759 raft_consensus.cc:504] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.559190 16759 leader_election.cc:288] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 1 election: Requested vote from peers 1e3692757b61436dade71922df50600d (127.16.10.66:41879), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.559617 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:11:56.559614 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:11:56.559789 16633 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.559831 16707 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.561848 16633 raft_consensus.cc:2454] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 1.
I20240503 08:11:56.561930 16707 raft_consensus.cc:2454] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 1.
I20240503 08:11:56.562196 16521 leader_election.cc:302] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:56.562464 16759 raft_consensus.cc:2781] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:11:56.562812 16759 raft_consensus.cc:686] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 1 LEADER]: Becoming Leader. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:11:56.563093 16759 consensus_queue.cc:237] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.565627 16453 catalog_manager.cc:5484] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f reported cstate change: term changed from 0 to 1, leader changed from <none> to ca07569acd3c4788a18088342811372f (127.16.10.65). New cstate: current_term: 1 leader_uuid: "ca07569acd3c4788a18088342811372f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:11:56.573038 16759 raft_consensus.cc:482] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:11:56.573210 16759 raft_consensus.cc:504] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.573693 16759 leader_election.cc:288] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e3692757b61436dade71922df50600d (127.16.10.66:41879), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.574040 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3692757b61436dade71922df50600d" is_pre_election: true
I20240503 08:11:56.574112 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b" is_pre_election: true
I20240503 08:11:56.574239 16633 raft_consensus.cc:2454] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 0.
I20240503 08:11:56.574275 16707 raft_consensus.cc:2454] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 0.
I20240503 08:11:56.574538 16521 leader_election.cc:302] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:56.574805 16759 raft_consensus.cc:2781] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:11:56.574900 16759 raft_consensus.cc:482] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:11:56.574997 16759 raft_consensus.cc:3037] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.577199 16759 raft_consensus.cc:504] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.577984 16759 leader_election.cc:288] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 1 election: Requested vote from peers 1e3692757b61436dade71922df50600d (127.16.10.66:41879), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.578452 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:11:56.578480 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:11:56.578665 16707 raft_consensus.cc:3037] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.578670 16633 raft_consensus.cc:3037] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.581485 16633 raft_consensus.cc:2454] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 1.
I20240503 08:11:56.581723 16707 raft_consensus.cc:2454] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 1.
I20240503 08:11:56.581974 16521 leader_election.cc:302] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:56.582363 16759 raft_consensus.cc:2781] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:11:56.582556 16759 raft_consensus.cc:686] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 1 LEADER]: Becoming Leader. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:11:56.582828 16759 consensus_queue.cc:237] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.585685 16453 catalog_manager.cc:5484] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f reported cstate change: term changed from 0 to 1, leader changed from <none> to ca07569acd3c4788a18088342811372f (127.16.10.65). New cstate: current_term: 1 leader_uuid: "ca07569acd3c4788a18088342811372f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:11:56.645706 16775 raft_consensus.cc:482] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:11:56.645917 16775 raft_consensus.cc:504] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.646703 16775 leader_election.cc:288] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), 1e3692757b61436dade71922df50600d (127.16.10.66:41879)
I20240503 08:11:56.647250 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f" is_pre_election: true
I20240503 08:11:56.647300 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3692757b61436dade71922df50600d" is_pre_election: true
I20240503 08:11:56.647461 16558 raft_consensus.cc:2454] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 0.
I20240503 08:11:56.647540 16633 raft_consensus.cc:2454] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 0.
I20240503 08:11:56.647838 16670 leader_election.cc:302] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf2731df95a4745b333c70360f1df6b, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:56.648100 16775 raft_consensus.cc:2781] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:11:56.648218 16775 raft_consensus.cc:482] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:11:56.648305 16775 raft_consensus.cc:3037] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.652850 16775 raft_consensus.cc:504] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.653441 16775 leader_election.cc:288] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), 1e3692757b61436dade71922df50600d (127.16.10.66:41879)
I20240503 08:11:56.653903 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:11:56.653923 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:11:56.654057 16558 raft_consensus.cc:3037] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.654093 16633 raft_consensus.cc:3037] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.655591 16784 raft_consensus.cc:482] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:11:56.655743 16784 raft_consensus.cc:504] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.656246 16558 raft_consensus.cc:2454] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 1.
I20240503 08:11:56.656397 16784 leader_election.cc:288] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.656476 16633 raft_consensus.cc:2454] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 1.
I20240503 08:11:56.656803 16670 leader_election.cc:302] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, adf2731df95a4745b333c70360f1df6b; no voters:
I20240503 08:11:56.656836 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59ae9bb05e914e07be3ab9a3d7003b38" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f" is_pre_election: true
I20240503 08:11:56.656838 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59ae9bb05e914e07be3ab9a3d7003b38" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b" is_pre_election: true
I20240503 08:11:56.657075 16558 raft_consensus.cc:2454] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 0.
I20240503 08:11:56.657104 16775 raft_consensus.cc:2781] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:11:56.657127 16707 raft_consensus.cc:2454] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 0.
I20240503 08:11:56.657464 16598 leader_election.cc:302] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, adf2731df95a4745b333c70360f1df6b; no voters:
I20240503 08:11:56.657546 16775 raft_consensus.cc:686] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Becoming Leader. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:11:56.657688 16784 raft_consensus.cc:2781] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:11:56.657819 16784 raft_consensus.cc:482] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:11:56.657898 16784 raft_consensus.cc:3037] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.657845 16775 consensus_queue.cc:237] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.659817 16775 raft_consensus.cc:482] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:11:56.659958 16775 raft_consensus.cc:504] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.660176 16784 raft_consensus.cc:504] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.660480 16775 leader_election.cc:288] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), 1e3692757b61436dade71922df50600d (127.16.10.66:41879)
I20240503 08:11:56.660583 16453 catalog_manager.cc:5484] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b reported cstate change: term changed from 0 to 1, leader changed from <none> to adf2731df95a4745b333c70360f1df6b (127.16.10.67). New cstate: current_term: 1 leader_uuid: "adf2731df95a4745b333c70360f1df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: HEALTHY } } }
I20240503 08:11:56.660856 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d9bcc6ca914e379a077bd28ce52b27" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f" is_pre_election: true
I20240503 08:11:56.661113 16558 raft_consensus.cc:2454] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 0.
I20240503 08:11:56.661262 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59ae9bb05e914e07be3ab9a3d7003b38" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:11:56.661425 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d9bcc6ca914e379a077bd28ce52b27" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3692757b61436dade71922df50600d" is_pre_election: true
I20240503 08:11:56.661520 16557 raft_consensus.cc:3037] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.661613 16633 raft_consensus.cc:2454] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 0.
I20240503 08:11:56.661515 16670 leader_election.cc:302] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf2731df95a4745b333c70360f1df6b, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:56.661934 16775 raft_consensus.cc:2781] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:11:56.662083 16775 raft_consensus.cc:482] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:11:56.662220 16775 raft_consensus.cc:3037] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.663902 16784 leader_election.cc:288] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.664315 16557 raft_consensus.cc:2454] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 1.
I20240503 08:11:56.664462 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59ae9bb05e914e07be3ab9a3d7003b38" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:11:56.664682 16707 raft_consensus.cc:3037] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.664744 16596 leader_election.cc:302] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:56.665037 16784 raft_consensus.cc:2781] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:11:56.665203 16784 raft_consensus.cc:686] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Becoming Leader. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:11:56.665488 16784 consensus_queue.cc:237] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.665535 16775 raft_consensus.cc:504] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.666364 16775 leader_election.cc:288] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), 1e3692757b61436dade71922df50600d (127.16.10.66:41879)
I20240503 08:11:56.666581 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d9bcc6ca914e379a077bd28ce52b27" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:11:56.666671 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d9bcc6ca914e379a077bd28ce52b27" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:11:56.666831 16633 raft_consensus.cc:3037] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.666851 16557 raft_consensus.cc:3037] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.668772 16453 catalog_manager.cc:5484] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e3692757b61436dade71922df50600d (127.16.10.66). New cstate: current_term: 1 leader_uuid: "1e3692757b61436dade71922df50600d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:11:56.669234 16633 raft_consensus.cc:2454] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 1.
I20240503 08:11:56.669615 16670 leader_election.cc:302] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, adf2731df95a4745b333c70360f1df6b; no voters:
I20240503 08:11:56.669685 16557 raft_consensus.cc:2454] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 1.
I20240503 08:11:56.669874 16775 raft_consensus.cc:2781] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:11:56.670032 16775 raft_consensus.cc:686] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Becoming Leader. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:11:56.670284 16775 consensus_queue.cc:237] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.670739 16707 raft_consensus.cc:2454] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 1.
I20240503 08:11:56.672746 16453 catalog_manager.cc:5484] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b reported cstate change: term changed from 0 to 1, leader changed from <none> to adf2731df95a4745b333c70360f1df6b (127.16.10.67). New cstate: current_term: 1 leader_uuid: "adf2731df95a4745b333c70360f1df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: HEALTHY } } }
I20240503 08:11:56.717695 16633 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3f4e21092f9746209444c8f5b7f5964d"
dest_uuid: "1e3692757b61436dade71922df50600d"
mode: GRACEFUL
new_leader_uuid: "ca07569acd3c4788a18088342811372f"
from {username='slave'} at 127.0.0.1:40254
I20240503 08:11:56.717945 16633 raft_consensus.cc:595] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Received request to transfer leadership to TS ca07569acd3c4788a18088342811372f
I20240503 08:11:56.725149 16707 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9"
dest_uuid: "adf2731df95a4745b333c70360f1df6b"
mode: GRACEFUL
new_leader_uuid: "ca07569acd3c4788a18088342811372f"
from {username='slave'} at 127.0.0.1:41006
I20240503 08:11:56.725318 16707 raft_consensus.cc:595] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Received request to transfer leadership to TS ca07569acd3c4788a18088342811372f
I20240503 08:11:56.727087 16707 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f8d9bcc6ca914e379a077bd28ce52b27"
dest_uuid: "adf2731df95a4745b333c70360f1df6b"
mode: GRACEFUL
new_leader_uuid: "ca07569acd3c4788a18088342811372f"
from {username='slave'} at 127.0.0.1:41006
I20240503 08:11:56.727231 16707 raft_consensus.cc:595] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Received request to transfer leadership to TS ca07569acd3c4788a18088342811372f
I20240503 08:11:56.732718 16557 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd"
dest_uuid: "ca07569acd3c4788a18088342811372f"
mode: GRACEFUL
new_leader_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:51824
I20240503 08:11:56.732880 16557 raft_consensus.cc:595] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 1 LEADER]: Received request to transfer leadership to TS 1e3692757b61436dade71922df50600d
I20240503 08:11:56.735507 16707 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b"
dest_uuid: "adf2731df95a4745b333c70360f1df6b"
mode: GRACEFUL
new_leader_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:41006
I20240503 08:11:56.735651 16707 raft_consensus.cc:595] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Received request to transfer leadership to TS 1e3692757b61436dade71922df50600d
I20240503 08:11:56.738272 16633 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d6353a8d0f274677b6b476eedc789f6f"
dest_uuid: "1e3692757b61436dade71922df50600d"
mode: GRACEFUL
new_leader_uuid: "adf2731df95a4745b333c70360f1df6b"
from {username='slave'} at 127.0.0.1:40254
I20240503 08:11:56.738411 16633 raft_consensus.cc:595] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Received request to transfer leadership to TS adf2731df95a4745b333c70360f1df6b
I20240503 08:11:56.763638 16784 raft_consensus.cc:482] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:11:56.763886 16784 raft_consensus.cc:504] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.764544 16784 leader_election.cc:288] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.765100 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca07569acd3c4788a18088342811372f" is_pre_election: true
I20240503 08:11:56.765151 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf2731df95a4745b333c70360f1df6b" is_pre_election: true
I20240503 08:11:56.765395 16557 raft_consensus.cc:2379] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e3692757b61436dade71922df50600d in current term 1: Already voted for candidate adf2731df95a4745b333c70360f1df6b in this term.
I20240503 08:11:56.765830 16596 leader_election.cc:302] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e3692757b61436dade71922df50600d; no voters: adf2731df95a4745b333c70360f1df6b, ca07569acd3c4788a18088342811372f
I20240503 08:11:56.766099 16784 raft_consensus.cc:3037] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:11:56.768244 16784 raft_consensus.cc:2726] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:11:56.873095 16775 consensus_queue.cc:1035] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:56.877549 16775 consensus_queue.cc:1035] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:56.880189 16749 raft_consensus.cc:979] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b: : Instructing follower 1e3692757b61436dade71922df50600d to start an election
I20240503 08:11:56.880350 16749 raft_consensus.cc:1067] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Signalling peer 1e3692757b61436dade71922df50600d to start an election
I20240503 08:11:56.881119 16633 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b"
dest_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:40236
I20240503 08:11:56.881299 16633 raft_consensus.cc:482] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:11:56.881422 16633 raft_consensus.cc:3037] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:56.883795 16633 raft_consensus.cc:504] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.884442 16633 leader_election.cc:288] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 2 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.884878 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:11:56.884878 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:11:56.885123 16557 raft_consensus.cc:3037] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:56.885131 16707 raft_consensus.cc:3032] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:11:56.885228 16707 raft_consensus.cc:729] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:11:56.885546 16707 consensus_queue.cc:260] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.886179 16707 raft_consensus.cc:3037] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:56.888137 16557 raft_consensus.cc:2454] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 2.
I20240503 08:11:56.888517 16596 leader_election.cc:302] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:56.888819 16707 raft_consensus.cc:2454] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 2.
I20240503 08:11:56.888839 16784 raft_consensus.cc:2781] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:11:56.889003 16784 raft_consensus.cc:686] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 2 LEADER]: Becoming Leader. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:11:56.889293 16784 consensus_queue.cc:237] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.891301 16454 catalog_manager.cc:5484] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d reported cstate change: term changed from 1 to 2, leader changed from adf2731df95a4745b333c70360f1df6b (127.16.10.67) to 1e3692757b61436dade71922df50600d (127.16.10.66). New cstate: current_term: 2 leader_uuid: "1e3692757b61436dade71922df50600d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:11:56.906404 16753 consensus_queue.cc:1035] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:56.910511 16753 consensus_queue.cc:1035] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:56.954499 16759 consensus_queue.cc:1035] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:56.958498 16806 consensus_queue.cc:1035] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:56.961275 16759 raft_consensus.cc:979] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f: : Instructing follower 1e3692757b61436dade71922df50600d to start an election
I20240503 08:11:56.961448 16759 raft_consensus.cc:1067] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 1 LEADER]: Signalling peer 1e3692757b61436dade71922df50600d to start an election
I20240503 08:11:56.962036 16633 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd"
dest_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:40238
I20240503 08:11:56.962241 16633 raft_consensus.cc:482] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:11:56.962373 16633 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:56.964321 16633 raft_consensus.cc:504] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.964967 16633 leader_election.cc:288] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 2 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:56.965423 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:11:56.965430 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:11:56.965621 16557 raft_consensus.cc:3032] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:11:56.965685 16707 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:56.965708 16557 raft_consensus.cc:729] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:11:56.965991 16557 consensus_queue.cc:260] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.966396 16557 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:56.967936 16707 raft_consensus.cc:2454] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 2.
I20240503 08:11:56.968297 16598 leader_election.cc:302] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, adf2731df95a4745b333c70360f1df6b; no voters:
I20240503 08:11:56.968437 16557 raft_consensus.cc:2454] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 2.
I20240503 08:11:56.968636 16786 raft_consensus.cc:2781] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:11:56.968804 16786 raft_consensus.cc:686] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 2 LEADER]: Becoming Leader. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:11:56.969043 16786 consensus_queue.cc:237] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.970808 16453 catalog_manager.cc:5484] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d reported cstate change: term changed from 1 to 2, leader changed from ca07569acd3c4788a18088342811372f (127.16.10.65) to 1e3692757b61436dade71922df50600d (127.16.10.66). New cstate: current_term: 2 leader_uuid: "1e3692757b61436dade71922df50600d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:11:56.975826 16786 consensus_queue.cc:1035] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:56.979322 16753 consensus_queue.cc:1035] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:56.981751 16784 raft_consensus.cc:979] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d: : Instructing follower adf2731df95a4745b333c70360f1df6b to start an election
I20240503 08:11:56.981899 16784 raft_consensus.cc:1067] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Signalling peer adf2731df95a4745b333c70360f1df6b to start an election
I20240503 08:11:56.982445 16707 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d6353a8d0f274677b6b476eedc789f6f"
dest_uuid: "adf2731df95a4745b333c70360f1df6b"
from {username='slave'} at 127.0.0.1:40986
I20240503 08:11:56.982662 16707 raft_consensus.cc:482] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:11:56.982796 16707 raft_consensus.cc:3037] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:56.984648 16707 raft_consensus.cc:504] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.985180 16707 leader_election.cc:288] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 2 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), 1e3692757b61436dade71922df50600d (127.16.10.66:41879)
I20240503 08:11:56.985643 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6353a8d0f274677b6b476eedc789f6f" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:11:56.985787 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6353a8d0f274677b6b476eedc789f6f" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:11:56.985849 16557 raft_consensus.cc:3037] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:56.985965 16633 raft_consensus.cc:3032] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:11:56.986057 16633 raft_consensus.cc:729] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:11:56.986300 16633 consensus_queue.cc:260] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.986670 16633 raft_consensus.cc:3037] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:56.988736 16557 raft_consensus.cc:2454] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 2.
I20240503 08:11:56.989122 16670 leader_election.cc:302] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf2731df95a4745b333c70360f1df6b, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:56.989286 16633 raft_consensus.cc:2454] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 2.
I20240503 08:11:56.989410 16749 raft_consensus.cc:2781] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:11:56.989607 16749 raft_consensus.cc:686] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 2 LEADER]: Becoming Leader. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:11:56.989872 16749 consensus_queue.cc:237] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:56.992343 16454 catalog_manager.cc:5484] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b reported cstate change: term changed from 1 to 2, leader changed from 1e3692757b61436dade71922df50600d (127.16.10.66) to adf2731df95a4745b333c70360f1df6b (127.16.10.67). New cstate: current_term: 2 leader_uuid: "adf2731df95a4745b333c70360f1df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: HEALTHY } } }
I20240503 08:11:57.060247 16784 consensus_queue.cc:1035] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:57.064452 16784 consensus_queue.cc:1035] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:57.064800 16753 consensus_queue.cc:1035] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:57.071739 16784 raft_consensus.cc:979] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d: : Instructing follower ca07569acd3c4788a18088342811372f to start an election
I20240503 08:11:57.071928 16784 raft_consensus.cc:1067] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Signalling peer ca07569acd3c4788a18088342811372f to start an election
I20240503 08:11:57.073899 16557 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3f4e21092f9746209444c8f5b7f5964d"
dest_uuid: "ca07569acd3c4788a18088342811372f"
from {username='slave'} at 127.0.0.1:51818
I20240503 08:11:57.074230 16557 raft_consensus.cc:482] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:11:57.074355 16557 raft_consensus.cc:3037] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:57.075640 16753 consensus_queue.cc:1035] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:57.077476 16557 raft_consensus.cc:504] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:57.078785 16557 leader_election.cc:288] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 2 election: Requested vote from peers 1e3692757b61436dade71922df50600d (127.16.10.66:41879), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:57.079604 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f4e21092f9746209444c8f5b7f5964d" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:11:57.079792 16633 raft_consensus.cc:3032] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:11:57.079903 16633 raft_consensus.cc:729] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:11:57.080152 16633 consensus_queue.cc:260] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:57.080438 16633 raft_consensus.cc:3037] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:57.082334 16633 raft_consensus.cc:2454] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 2.
I20240503 08:11:57.082681 16521 leader_election.cc:302] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:57.082791 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f4e21092f9746209444c8f5b7f5964d" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:11:57.082976 16759 raft_consensus.cc:2781] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:11:57.082985 16707 raft_consensus.cc:3037] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:57.083168 16759 raft_consensus.cc:686] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Becoming Leader. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:11:57.083451 16759 consensus_queue.cc:237] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:57.085078 16759 consensus_queue.cc:1035] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:57.085644 16707 raft_consensus.cc:2454] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 2.
I20240503 08:11:57.085662 16453 catalog_manager.cc:5484] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f reported cstate change: term changed from 1 to 2, leader changed from 1e3692757b61436dade71922df50600d (127.16.10.66) to ca07569acd3c4788a18088342811372f (127.16.10.65). New cstate: current_term: 2 leader_uuid: "ca07569acd3c4788a18088342811372f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:11:57.088968 16806 consensus_queue.cc:1035] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:57.138372 16749 consensus_queue.cc:1035] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:57.143219 16775 consensus_queue.cc:1035] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:57.145794 16749 raft_consensus.cc:979] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b: : Instructing follower ca07569acd3c4788a18088342811372f to start an election
I20240503 08:11:57.145964 16749 raft_consensus.cc:1067] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Signalling peer ca07569acd3c4788a18088342811372f to start an election
I20240503 08:11:57.145962 16775 consensus_queue.cc:1035] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:57.146930 16557 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f8d9bcc6ca914e379a077bd28ce52b27"
dest_uuid: "ca07569acd3c4788a18088342811372f"
from {username='slave'} at 127.0.0.1:51802
I20240503 08:11:57.147114 16557 raft_consensus.cc:482] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:11:57.147217 16557 raft_consensus.cc:3037] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:57.150784 16775 consensus_queue.cc:1035] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:11:57.151554 16557 raft_consensus.cc:504] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:57.152297 16557 leader_election.cc:288] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 2 election: Requested vote from peers 1e3692757b61436dade71922df50600d (127.16.10.66:41879), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:57.152773 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d9bcc6ca914e379a077bd28ce52b27" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:11:57.152931 16633 raft_consensus.cc:3037] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:57.153209 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d9bcc6ca914e379a077bd28ce52b27" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:11:57.153429 16707 raft_consensus.cc:3032] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:11:57.153548 16707 raft_consensus.cc:729] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:11:57.153826 16707 consensus_queue.cc:260] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:57.154223 16707 raft_consensus.cc:3037] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:57.155308 16633 raft_consensus.cc:2454] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 2.
I20240503 08:11:57.155711 16521 leader_election.cc:302] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:57.155993 16806 raft_consensus.cc:2781] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:11:57.156133 16806 raft_consensus.cc:686] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Becoming Leader. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:11:57.156527 16775 raft_consensus.cc:979] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b: : Instructing follower ca07569acd3c4788a18088342811372f to start an election
I20240503 08:11:57.156477 16806 consensus_queue.cc:237] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:57.156667 16775 raft_consensus.cc:1067] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Signalling peer ca07569acd3c4788a18088342811372f to start an election
I20240503 08:11:57.157264 16558 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9"
dest_uuid: "ca07569acd3c4788a18088342811372f"
from {username='slave'} at 127.0.0.1:51802
I20240503 08:11:57.157707 16558 raft_consensus.cc:482] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:11:57.157847 16558 raft_consensus.cc:3037] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:57.158069 16707 raft_consensus.cc:2454] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 2.
I20240503 08:11:57.159117 16454 catalog_manager.cc:5484] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f reported cstate change: term changed from 1 to 2, leader changed from adf2731df95a4745b333c70360f1df6b (127.16.10.67) to ca07569acd3c4788a18088342811372f (127.16.10.65). New cstate: current_term: 2 leader_uuid: "ca07569acd3c4788a18088342811372f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:11:57.160378 16558 raft_consensus.cc:504] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:57.161135 16558 leader_election.cc:288] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 2 election: Requested vote from peers 1e3692757b61436dade71922df50600d (127.16.10.66:41879), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:11:57.161684 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:11:57.161809 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:11:57.161917 16633 raft_consensus.cc:3037] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:57.162150 16707 raft_consensus.cc:3032] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:11:57.162273 16707 raft_consensus.cc:729] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:11:57.162529 16707 consensus_queue.cc:260] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:57.162851 16707 raft_consensus.cc:3037] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:11:57.164247 16633 raft_consensus.cc:2454] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 2.
I20240503 08:11:57.164582 16521 leader_election.cc:302] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:11:57.164831 16759 raft_consensus.cc:2781] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:11:57.164970 16759 raft_consensus.cc:686] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Becoming Leader. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:11:57.164995 16707 raft_consensus.cc:2454] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 2.
I20240503 08:11:57.165236 16759 consensus_queue.cc:237] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:11:57.167189 16454 catalog_manager.cc:5484] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f reported cstate change: term changed from 1 to 2, leader changed from adf2731df95a4745b333c70360f1df6b (127.16.10.67) to ca07569acd3c4788a18088342811372f (127.16.10.65). New cstate: current_term: 2 leader_uuid: "ca07569acd3c4788a18088342811372f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:11:57.354677 16707 raft_consensus.cc:1261] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:11:57.355244 16753 consensus_queue.cc:1035] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:11:57.358493 16558 raft_consensus.cc:1261] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:11:57.359001 16786 consensus_queue.cc:1035] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:11:57.384704 16707 raft_consensus.cc:1261] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:11:57.385277 16786 consensus_queue.cc:1035] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:11:57.388326 16558 raft_consensus.cc:1261] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:11:57.388818 16784 consensus_queue.cc:1035] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:11:57.535810 16633 raft_consensus.cc:1261] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Refusing update from remote peer adf2731df95a4745b333c70360f1df6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:11:57.536382 16818 consensus_queue.cc:1035] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:11:57.539337 16558 raft_consensus.cc:1261] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Refusing update from remote peer adf2731df95a4745b333c70360f1df6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:11:57.539777 16775 consensus_queue.cc:1035] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:11:57.542133 16707 raft_consensus.cc:1261] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Refusing update from remote peer ca07569acd3c4788a18088342811372f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:11:57.542624 16759 consensus_queue.cc:1035] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:11:57.545414 16633 raft_consensus.cc:1261] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Refusing update from remote peer ca07569acd3c4788a18088342811372f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:11:57.545904 16806 consensus_queue.cc:1035] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:11:57.582329 16707 raft_consensus.cc:1261] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Refusing update from remote peer ca07569acd3c4788a18088342811372f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:11:57.582890 16806 consensus_queue.cc:1035] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:11:57.585875 16633 raft_consensus.cc:1261] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Refusing update from remote peer ca07569acd3c4788a18088342811372f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:11:57.586601 16791 consensus_queue.cc:1035] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:11:57.693745 16707 raft_consensus.cc:1261] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Refusing update from remote peer ca07569acd3c4788a18088342811372f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:11:57.694276 16759 consensus_queue.cc:1035] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:11:57.697248 16633 raft_consensus.cc:1261] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Refusing update from remote peer ca07569acd3c4788a18088342811372f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:11:57.698372 16791 consensus_queue.cc:1035] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:11:59.748339 16425 auto_leader_rebalancer-test.cc:261] The leader distribution is
I20240503 08:11:59.748687 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:11:59.756333 16633 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd"
dest_uuid: "1e3692757b61436dade71922df50600d"
mode: GRACEFUL
new_leader_uuid: "adf2731df95a4745b333c70360f1df6b"
from {username='slave'} at 127.0.0.1:40262
I20240503 08:11:59.756513 16633 raft_consensus.cc:595] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 2 LEADER]: Received request to transfer leadership to TS adf2731df95a4745b333c70360f1df6b
I20240503 08:11:59.761965 16558 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5"
dest_uuid: "ca07569acd3c4788a18088342811372f"
mode: GRACEFUL
new_leader_uuid: "adf2731df95a4745b333c70360f1df6b"
from {username='slave'} at 127.0.0.1:51828
I20240503 08:11:59.762182 16558 raft_consensus.cc:595] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 1 LEADER]: Received request to transfer leadership to TS adf2731df95a4745b333c70360f1df6b
I20240503 08:11:59.762625 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240503 08:11:59.762962 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:00.162631 16828 raft_consensus.cc:979] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d: : Instructing follower adf2731df95a4745b333c70360f1df6b to start an election
I20240503 08:12:00.162849 16753 raft_consensus.cc:1067] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 2 LEADER]: Signalling peer adf2731df95a4745b333c70360f1df6b to start an election
I20240503 08:12:00.163470 16707 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd"
dest_uuid: "adf2731df95a4745b333c70360f1df6b"
from {username='slave'} at 127.0.0.1:40986
I20240503 08:12:00.163690 16707 raft_consensus.cc:482] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:00.163816 16707 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:00.165818 16707 raft_consensus.cc:504] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:00.166402 16707 leader_election.cc:288] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 3 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), 1e3692757b61436dade71922df50600d (127.16.10.66:41879)
I20240503 08:12:00.166805 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:12:00.166859 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:12:00.167006 16558 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:00.167029 16633 raft_consensus.cc:3032] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:12:00.167141 16633 raft_consensus.cc:729] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:12:00.167430 16633 consensus_queue.cc:260] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:00.167790 16633 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:00.169286 16558 raft_consensus.cc:2454] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 3.
I20240503 08:12:00.169669 16670 leader_election.cc:302] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf2731df95a4745b333c70360f1df6b, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:12:00.169785 16633 raft_consensus.cc:2454] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 3.
I20240503 08:12:00.169952 16822 raft_consensus.cc:2781] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:12:00.170384 16822 raft_consensus.cc:686] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 3 LEADER]: Becoming Leader. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:12:00.170738 16822 consensus_queue.cc:237] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:00.172416 16831 raft_consensus.cc:979] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f: : Instructing follower adf2731df95a4745b333c70360f1df6b to start an election
I20240503 08:12:00.172564 16831 raft_consensus.cc:1067] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 1 LEADER]: Signalling peer adf2731df95a4745b333c70360f1df6b to start an election
I20240503 08:12:00.173154 16707 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5"
dest_uuid: "adf2731df95a4745b333c70360f1df6b"
from {username='slave'} at 127.0.0.1:41000
I20240503 08:12:00.173297 16707 raft_consensus.cc:482] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:00.173420 16707 raft_consensus.cc:3037] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:00.173388 16455 catalog_manager.cc:5484] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b reported cstate change: term changed from 2 to 3, leader changed from 1e3692757b61436dade71922df50600d (127.16.10.66) to adf2731df95a4745b333c70360f1df6b (127.16.10.67). New cstate: current_term: 3 leader_uuid: "adf2731df95a4745b333c70360f1df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:00.175339 16707 raft_consensus.cc:504] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:00.176057 16707 leader_election.cc:288] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 2 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), 1e3692757b61436dade71922df50600d (127.16.10.66:41879)
I20240503 08:12:00.176427 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:12:00.176615 16633 raft_consensus.cc:3037] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:00.176625 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:12:00.176890 16558 raft_consensus.cc:3032] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:12:00.177006 16558 raft_consensus.cc:729] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:12:00.177278 16558 consensus_queue.cc:260] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:00.177711 16558 raft_consensus.cc:3037] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:00.178761 16633 raft_consensus.cc:2454] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 2.
I20240503 08:12:00.179237 16670 leader_election.cc:302] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, adf2731df95a4745b333c70360f1df6b; no voters:
I20240503 08:12:00.179572 16822 raft_consensus.cc:2781] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:12:00.179759 16822 raft_consensus.cc:686] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 2 LEADER]: Becoming Leader. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:12:00.180024 16822 consensus_queue.cc:237] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:00.180511 16558 raft_consensus.cc:2454] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 2.
I20240503 08:12:00.182476 16455 catalog_manager.cc:5484] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b reported cstate change: term changed from 1 to 2, leader changed from ca07569acd3c4788a18088342811372f (127.16.10.65) to adf2731df95a4745b333c70360f1df6b (127.16.10.67). New cstate: current_term: 2 leader_uuid: "adf2731df95a4745b333c70360f1df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:00.692047 16633 raft_consensus.cc:1261] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Refusing update from remote peer adf2731df95a4745b333c70360f1df6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:00.692606 16822 consensus_queue.cc:1035] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:00.697038 16558 raft_consensus.cc:1261] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Refusing update from remote peer adf2731df95a4745b333c70360f1df6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:00.697547 16838 consensus_queue.cc:1035] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:00.749862 16633 raft_consensus.cc:1261] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Refusing update from remote peer adf2731df95a4745b333c70360f1df6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:00.750430 16838 consensus_queue.cc:1035] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:00.754561 16558 raft_consensus.cc:1261] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Refusing update from remote peer adf2731df95a4745b333c70360f1df6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:00.755091 16822 consensus_queue.cc:1035] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:00.763294 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:00.765120 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:00.765336 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:01.765625 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:01.767793 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:01.767987 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:02.768314 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:02.769995 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:02.770154 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:03.770465 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:03.772130 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:03.772266 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:04.773353 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:04.774880 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:04.775038 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:05.775463 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:05.777187 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:05.777333 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:06.777698 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:06.779382 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:06.779585 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:07.779942 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:07.781618 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:07.781760 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:08.782121 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:08.783910 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:08.784065 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:09.794075 16425 auto_leader_rebalancer-test.cc:280] The leader distribution is
I20240503 08:12:09.795949 16557 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3f4e21092f9746209444c8f5b7f5964d"
dest_uuid: "ca07569acd3c4788a18088342811372f"
mode: GRACEFUL
new_leader_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:51824
I20240503 08:12:09.796165 16557 raft_consensus.cc:595] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Received request to transfer leadership to TS 1e3692757b61436dade71922df50600d
I20240503 08:12:09.798086 16707 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5"
dest_uuid: "adf2731df95a4745b333c70360f1df6b"
mode: GRACEFUL
new_leader_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:41006
I20240503 08:12:09.798266 16707 raft_consensus.cc:595] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 2 LEADER]: Received request to transfer leadership to TS 1e3692757b61436dade71922df50600d
I20240503 08:12:09.800112 16557 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9"
dest_uuid: "ca07569acd3c4788a18088342811372f"
mode: GRACEFUL
new_leader_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:51824
I20240503 08:12:09.800273 16557 raft_consensus.cc:595] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Received request to transfer leadership to TS 1e3692757b61436dade71922df50600d
I20240503 08:12:09.802026 16557 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f8d9bcc6ca914e379a077bd28ce52b27"
dest_uuid: "ca07569acd3c4788a18088342811372f"
mode: GRACEFUL
new_leader_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:51824
I20240503 08:12:09.802175 16557 raft_consensus.cc:595] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Received request to transfer leadership to TS 1e3692757b61436dade71922df50600d
I20240503 08:12:09.803849 16707 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd"
dest_uuid: "adf2731df95a4745b333c70360f1df6b"
mode: GRACEFUL
new_leader_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:41006
I20240503 08:12:09.804003 16707 raft_consensus.cc:595] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 3 LEADER]: Received request to transfer leadership to TS 1e3692757b61436dade71922df50600d
I20240503 08:12:09.887109 16845 raft_consensus.cc:979] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b: : Instructing follower 1e3692757b61436dade71922df50600d to start an election
I20240503 08:12:09.887253 16845 raft_consensus.cc:1067] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 2 LEADER]: Signalling peer 1e3692757b61436dade71922df50600d to start an election
I20240503 08:12:09.887851 16633 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5"
dest_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:40236
I20240503 08:12:09.888043 16633 raft_consensus.cc:482] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:09.888144 16633 raft_consensus.cc:3037] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:09.890105 16633 raft_consensus.cc:504] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:09.890761 16633 leader_election.cc:288] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 3 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:12:09.891211 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:12:09.891366 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:12:09.891454 16707 raft_consensus.cc:3032] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:12:09.891551 16707 raft_consensus.cc:729] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:12:09.891577 16557 raft_consensus.cc:3037] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:09.891813 16707 consensus_queue.cc:260] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:09.892096 16707 raft_consensus.cc:3037] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:09.893582 16557 raft_consensus.cc:2454] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 3.
I20240503 08:12:09.893980 16596 leader_election.cc:302] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:12:09.894064 16707 raft_consensus.cc:2454] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 3.
I20240503 08:12:09.894269 16753 raft_consensus.cc:2781] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:12:09.894668 16753 raft_consensus.cc:686] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Becoming Leader. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:12:09.894969 16753 consensus_queue.cc:237] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:09.897378 16455 catalog_manager.cc:5484] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d reported cstate change: term changed from 2 to 3, leader changed from adf2731df95a4745b333c70360f1df6b (127.16.10.67) to 1e3692757b61436dade71922df50600d (127.16.10.66). New cstate: current_term: 3 leader_uuid: "1e3692757b61436dade71922df50600d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:09.987885 16859 raft_consensus.cc:979] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f: : Instructing follower 1e3692757b61436dade71922df50600d to start an election
I20240503 08:12:09.988073 16859 raft_consensus.cc:1067] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Signalling peer 1e3692757b61436dade71922df50600d to start an election
I20240503 08:12:09.988723 16633 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3f4e21092f9746209444c8f5b7f5964d"
dest_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:40238
I20240503 08:12:09.988904 16633 raft_consensus.cc:482] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:09.988999 16633 raft_consensus.cc:3037] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:09.990847 16633 raft_consensus.cc:504] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:09.991430 16633 leader_election.cc:288] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 3 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:12:09.991757 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f4e21092f9746209444c8f5b7f5964d" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:12:09.991874 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f4e21092f9746209444c8f5b7f5964d" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:12:09.991988 16557 raft_consensus.cc:3032] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:12:09.992059 16707 raft_consensus.cc:3037] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:09.992080 16557 raft_consensus.cc:729] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:12:09.992347 16557 consensus_queue.cc:260] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:09.992625 16557 raft_consensus.cc:3037] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:09.994329 16707 raft_consensus.cc:2454] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 3.
I20240503 08:12:09.994680 16598 leader_election.cc:302] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, adf2731df95a4745b333c70360f1df6b; no voters:
I20240503 08:12:09.994978 16753 raft_consensus.cc:2781] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:12:09.995023 16557 raft_consensus.cc:2454] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 3.
I20240503 08:12:09.995152 16753 raft_consensus.cc:686] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Becoming Leader. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:12:09.995378 16753 consensus_queue.cc:237] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:09.997925 16455 catalog_manager.cc:5484] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d reported cstate change: term changed from 2 to 3, leader changed from ca07569acd3c4788a18088342811372f (127.16.10.65) to 1e3692757b61436dade71922df50600d (127.16.10.66). New cstate: current_term: 3 leader_uuid: "1e3692757b61436dade71922df50600d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:10.040346 16831 raft_consensus.cc:979] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f: : Instructing follower 1e3692757b61436dade71922df50600d to start an election
I20240503 08:12:10.040530 16831 raft_consensus.cc:1067] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Signalling peer 1e3692757b61436dade71922df50600d to start an election
I20240503 08:12:10.041146 16633 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9"
dest_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:40238
I20240503 08:12:10.041329 16633 raft_consensus.cc:482] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:10.041453 16633 raft_consensus.cc:3037] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:10.043352 16633 raft_consensus.cc:504] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:10.043872 16633 leader_election.cc:288] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 3 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:12:10.044272 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:12:10.044353 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:12:10.044464 16557 raft_consensus.cc:3032] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:12:10.044517 16707 raft_consensus.cc:3037] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:10.044553 16557 raft_consensus.cc:729] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:12:10.044821 16557 consensus_queue.cc:260] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:10.045179 16557 raft_consensus.cc:3037] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:10.046855 16707 raft_consensus.cc:2454] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 3.
I20240503 08:12:10.047101 16557 raft_consensus.cc:2454] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 3.
I20240503 08:12:10.047212 16598 leader_election.cc:302] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, adf2731df95a4745b333c70360f1df6b; no voters:
I20240503 08:12:10.047513 16753 raft_consensus.cc:2781] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:12:10.047639 16753 raft_consensus.cc:686] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Becoming Leader. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:12:10.047902 16753 consensus_queue.cc:237] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:10.050257 16455 catalog_manager.cc:5484] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d reported cstate change: term changed from 2 to 3, leader changed from ca07569acd3c4788a18088342811372f (127.16.10.65) to 1e3692757b61436dade71922df50600d (127.16.10.66). New cstate: current_term: 3 leader_uuid: "1e3692757b61436dade71922df50600d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:10.144161 16859 raft_consensus.cc:979] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f: : Instructing follower 1e3692757b61436dade71922df50600d to start an election
I20240503 08:12:10.144331 16859 raft_consensus.cc:1067] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Signalling peer 1e3692757b61436dade71922df50600d to start an election
I20240503 08:12:10.144901 16633 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f8d9bcc6ca914e379a077bd28ce52b27"
dest_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:40238
I20240503 08:12:10.145121 16633 raft_consensus.cc:482] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:10.145262 16633 raft_consensus.cc:3037] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:10.147137 16633 raft_consensus.cc:504] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:10.147759 16633 leader_election.cc:288] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 3 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:12:10.148188 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d9bcc6ca914e379a077bd28ce52b27" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:12:10.148175 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d9bcc6ca914e379a077bd28ce52b27" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:12:10.148417 16707 raft_consensus.cc:3037] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:10.148442 16557 raft_consensus.cc:3032] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:12:10.148514 16557 raft_consensus.cc:729] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:12:10.148756 16557 consensus_queue.cc:260] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:10.149045 16557 raft_consensus.cc:3037] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:10.150461 16707 raft_consensus.cc:2454] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 3.
I20240503 08:12:10.150847 16598 leader_election.cc:302] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, adf2731df95a4745b333c70360f1df6b; no voters:
I20240503 08:12:10.150926 16557 raft_consensus.cc:2454] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 3.
I20240503 08:12:10.151170 16753 raft_consensus.cc:2781] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:12:10.151347 16753 raft_consensus.cc:686] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Becoming Leader. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:12:10.151592 16753 consensus_queue.cc:237] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:10.154083 16455 catalog_manager.cc:5484] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d reported cstate change: term changed from 2 to 3, leader changed from ca07569acd3c4788a18088342811372f (127.16.10.65) to 1e3692757b61436dade71922df50600d (127.16.10.66). New cstate: current_term: 3 leader_uuid: "1e3692757b61436dade71922df50600d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:10.207827 16852 raft_consensus.cc:979] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b: : Instructing follower 1e3692757b61436dade71922df50600d to start an election
I20240503 08:12:10.207981 16852 raft_consensus.cc:1067] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 3 LEADER]: Signalling peer 1e3692757b61436dade71922df50600d to start an election
I20240503 08:12:10.208609 16633 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd"
dest_uuid: "1e3692757b61436dade71922df50600d"
from {username='slave'} at 127.0.0.1:40236
I20240503 08:12:10.208809 16633 raft_consensus.cc:482] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:10.208907 16633 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:10.210768 16633 raft_consensus.cc:504] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:10.211354 16633 leader_election.cc:288] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 4 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:12:10.211691 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:12:10.211792 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd" candidate_uuid: "1e3692757b61436dade71922df50600d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:12:10.211869 16557 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:10.211970 16707 raft_consensus.cc:3032] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 3 LEADER]: Stepping down as leader of term 3
I20240503 08:12:10.212069 16707 raft_consensus.cc:729] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:12:10.212361 16707 consensus_queue.cc:260] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:10.212698 16707 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:10.213913 16557 raft_consensus.cc:2454] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 4.
I20240503 08:12:10.214260 16596 leader_election.cc:302] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:12:10.214547 16753 raft_consensus.cc:2781] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:12:10.214696 16707 raft_consensus.cc:2454] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e3692757b61436dade71922df50600d in term 4.
I20240503 08:12:10.214704 16753 raft_consensus.cc:686] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 4 LEADER]: Becoming Leader. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:12:10.215057 16753 consensus_queue.cc:237] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:10.217363 16455 catalog_manager.cc:5484] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d reported cstate change: term changed from 3 to 4, leader changed from adf2731df95a4745b333c70360f1df6b (127.16.10.67) to 1e3692757b61436dade71922df50600d (127.16.10.66). New cstate: current_term: 4 leader_uuid: "1e3692757b61436dade71922df50600d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:10.278776 16557 raft_consensus.cc:1261] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:10.279258 16753 consensus_queue.cc:1035] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:10.282791 16707 raft_consensus.cc:1261] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:10.283679 16866 consensus_queue.cc:1035] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:10.487208 16707 raft_consensus.cc:1261] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:10.487789 16866 consensus_queue.cc:1035] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:10.492036 16557 raft_consensus.cc:1261] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:10.492534 16866 consensus_queue.cc:1035] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:10.506945 16707 raft_consensus.cc:1261] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:10.507633 16866 consensus_queue.cc:1035] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:10.510893 16557 raft_consensus.cc:1261] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:10.511515 16753 consensus_queue.cc:1035] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:10.613356 16557 raft_consensus.cc:1261] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:10.613852 16753 consensus_queue.cc:1035] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:10.617933 16707 raft_consensus.cc:1261] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:10.618597 16753 consensus_queue.cc:1035] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:10.647608 16557 raft_consensus.cc:1261] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 4 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:12:10.648288 16866 consensus_queue.cc:1035] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:10.652555 16707 raft_consensus.cc:1261] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 4 FOLLOWER]: Refusing update from remote peer 1e3692757b61436dade71922df50600d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:12:10.653095 16853 consensus_queue.cc:1035] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:12.817191 16425 auto_leader_rebalancer-test.cc:295] The leader distribution is
I20240503 08:12:12.817456 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:12.819571 16633 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9"
dest_uuid: "1e3692757b61436dade71922df50600d"
mode: GRACEFUL
new_leader_uuid: "adf2731df95a4745b333c70360f1df6b"
from {username='slave'} at 127.0.0.1:40262
I20240503 08:12:12.819757 16633 raft_consensus.cc:595] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Received request to transfer leadership to TS adf2731df95a4745b333c70360f1df6b
I20240503 08:12:12.820713 16633 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "59ae9bb05e914e07be3ab9a3d7003b38"
dest_uuid: "1e3692757b61436dade71922df50600d"
mode: GRACEFUL
new_leader_uuid: "adf2731df95a4745b333c70360f1df6b"
from {username='slave'} at 127.0.0.1:40262
I20240503 08:12:12.820863 16633 raft_consensus.cc:595] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Received request to transfer leadership to TS adf2731df95a4745b333c70360f1df6b
I20240503 08:12:12.821691 16633 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b"
dest_uuid: "1e3692757b61436dade71922df50600d"
mode: GRACEFUL
new_leader_uuid: "ca07569acd3c4788a18088342811372f"
from {username='slave'} at 127.0.0.1:40262
I20240503 08:12:12.821822 16633 raft_consensus.cc:595] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 2 LEADER]: Received request to transfer leadership to TS ca07569acd3c4788a18088342811372f
I20240503 08:12:12.822654 16633 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd"
dest_uuid: "1e3692757b61436dade71922df50600d"
mode: GRACEFUL
new_leader_uuid: "ca07569acd3c4788a18088342811372f"
from {username='slave'} at 127.0.0.1:40262
I20240503 08:12:12.822777 16633 raft_consensus.cc:595] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 4 LEADER]: Received request to transfer leadership to TS ca07569acd3c4788a18088342811372f
I20240503 08:12:12.823649 16633 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5"
dest_uuid: "1e3692757b61436dade71922df50600d"
mode: GRACEFUL
new_leader_uuid: "ca07569acd3c4788a18088342811372f"
from {username='slave'} at 127.0.0.1:40262
I20240503 08:12:12.823773 16633 raft_consensus.cc:595] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Received request to transfer leadership to TS ca07569acd3c4788a18088342811372f
I20240503 08:12:12.824124 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 5
I20240503 08:12:12.824317 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:12.955031 16880 raft_consensus.cc:979] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d: : Instructing follower adf2731df95a4745b333c70360f1df6b to start an election
I20240503 08:12:12.955214 16880 raft_consensus.cc:1067] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Signalling peer adf2731df95a4745b333c70360f1df6b to start an election
I20240503 08:12:12.955797 16707 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "59ae9bb05e914e07be3ab9a3d7003b38"
dest_uuid: "adf2731df95a4745b333c70360f1df6b"
from {username='slave'} at 127.0.0.1:40986
I20240503 08:12:12.955996 16707 raft_consensus.cc:482] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:12.956084 16707 raft_consensus.cc:3037] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:12.957867 16707 raft_consensus.cc:504] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:12.958567 16707 leader_election.cc:288] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 2 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), 1e3692757b61436dade71922df50600d (127.16.10.66:41879)
I20240503 08:12:12.958978 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59ae9bb05e914e07be3ab9a3d7003b38" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:12:12.959097 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59ae9bb05e914e07be3ab9a3d7003b38" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:12:12.959194 16557 raft_consensus.cc:3037] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:12.959290 16633 raft_consensus.cc:3032] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:12:12.959381 16633 raft_consensus.cc:729] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:12:12.959635 16633 consensus_queue.cc:260] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:12.959962 16633 raft_consensus.cc:3037] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:12.961372 16557 raft_consensus.cc:2454] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 2.
I20240503 08:12:12.961827 16670 leader_election.cc:302] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf2731df95a4745b333c70360f1df6b, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:12:12.961882 16633 raft_consensus.cc:2454] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 2.
I20240503 08:12:12.962142 16852 raft_consensus.cc:2781] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:12:12.962546 16852 raft_consensus.cc:686] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 2 LEADER]: Becoming Leader. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:12:12.962815 16852 consensus_queue.cc:237] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:12.965198 16455 catalog_manager.cc:5484] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b reported cstate change: term changed from 1 to 2, leader changed from 1e3692757b61436dade71922df50600d (127.16.10.66) to adf2731df95a4745b333c70360f1df6b (127.16.10.67). New cstate: current_term: 2 leader_uuid: "adf2731df95a4745b333c70360f1df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:12.967864 16753 raft_consensus.cc:979] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d: : Instructing follower ca07569acd3c4788a18088342811372f to start an election
I20240503 08:12:12.968030 16753 raft_consensus.cc:1067] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Signalling peer ca07569acd3c4788a18088342811372f to start an election
I20240503 08:12:12.968755 16557 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5"
dest_uuid: "ca07569acd3c4788a18088342811372f"
from {username='slave'} at 127.0.0.1:51818
I20240503 08:12:12.968933 16557 raft_consensus.cc:482] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:12.969055 16557 raft_consensus.cc:3037] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:12.970815 16557 raft_consensus.cc:504] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:12.971518 16557 leader_election.cc:288] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 4 election: Requested vote from peers 1e3692757b61436dade71922df50600d (127.16.10.66:41879), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:12:12.971814 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:12:12.972018 16633 raft_consensus.cc:3032] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Stepping down as leader of term 3
I20240503 08:12:12.972123 16633 raft_consensus.cc:729] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:12:12.972340 16633 consensus_queue.cc:260] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:12.972602 16633 raft_consensus.cc:3037] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:12.974347 16633 raft_consensus.cc:2454] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 4.
I20240503 08:12:12.974646 16707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33015a162854ad2bf6cda67ddbb0ca5" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:12:12.974740 16521 leader_election.cc:302] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:12:12.974828 16707 raft_consensus.cc:3037] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:12.975687 16887 raft_consensus.cc:2781] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:12:12.975885 16880 raft_consensus.cc:979] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d: : Instructing follower adf2731df95a4745b333c70360f1df6b to start an election
I20240503 08:12:12.976047 16753 raft_consensus.cc:1067] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Signalling peer adf2731df95a4745b333c70360f1df6b to start an election
I20240503 08:12:12.976495 16887 raft_consensus.cc:686] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 4 LEADER]: Becoming Leader. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:12:12.976704 16706 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9"
dest_uuid: "adf2731df95a4745b333c70360f1df6b"
from {username='slave'} at 127.0.0.1:40986
I20240503 08:12:12.976888 16706 raft_consensus.cc:482] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:12.976785 16887 consensus_queue.cc:237] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:12.977020 16706 raft_consensus.cc:3037] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:12.977423 16707 raft_consensus.cc:2454] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 4.
I20240503 08:12:12.979529 16455 catalog_manager.cc:5484] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f reported cstate change: term changed from 3 to 4, leader changed from 1e3692757b61436dade71922df50600d (127.16.10.66) to ca07569acd3c4788a18088342811372f (127.16.10.65). New cstate: current_term: 4 leader_uuid: "ca07569acd3c4788a18088342811372f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:12.979794 16706 raft_consensus.cc:504] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:12.980446 16706 leader_election.cc:288] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 4 election: Requested vote from peers ca07569acd3c4788a18088342811372f (127.16.10.65:42565), 1e3692757b61436dade71922df50600d (127.16.10.66:41879)
I20240503 08:12:12.980691 16557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ca07569acd3c4788a18088342811372f"
I20240503 08:12:12.980775 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19cfbee898db4fd8acf071dd2dc16bc9" candidate_uuid: "adf2731df95a4745b333c70360f1df6b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:12:12.980878 16557 raft_consensus.cc:3037] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:12.980964 16633 raft_consensus.cc:3032] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Stepping down as leader of term 3
I20240503 08:12:12.981040 16633 raft_consensus.cc:729] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:12:12.981235 16633 consensus_queue.cc:260] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:12.981572 16633 raft_consensus.cc:3037] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:12.982998 16557 raft_consensus.cc:2454] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 4.
I20240503 08:12:12.983331 16670 leader_election.cc:302] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf2731df95a4745b333c70360f1df6b, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:12:12.983575 16852 raft_consensus.cc:2781] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:12:12.983721 16852 raft_consensus.cc:686] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 4 LEADER]: Becoming Leader. State: Replica: adf2731df95a4745b333c70360f1df6b, State: Running, Role: LEADER
I20240503 08:12:12.983983 16633 raft_consensus.cc:2454] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf2731df95a4745b333c70360f1df6b in term 4.
I20240503 08:12:12.983950 16852 consensus_queue.cc:237] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:12.986133 16455 catalog_manager.cc:5484] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b reported cstate change: term changed from 3 to 4, leader changed from 1e3692757b61436dade71922df50600d (127.16.10.66) to adf2731df95a4745b333c70360f1df6b (127.16.10.67). New cstate: current_term: 4 leader_uuid: "adf2731df95a4745b333c70360f1df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:13.109609 16880 raft_consensus.cc:979] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d: : Instructing follower ca07569acd3c4788a18088342811372f to start an election
I20240503 08:12:13.109828 16880 raft_consensus.cc:1067] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 4 LEADER]: Signalling peer ca07569acd3c4788a18088342811372f to start an election
I20240503 08:12:13.110462 16557 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd"
dest_uuid: "ca07569acd3c4788a18088342811372f"
from {username='slave'} at 127.0.0.1:51818
I20240503 08:12:13.110685 16557 raft_consensus.cc:482] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:13.110824 16557 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 4 FOLLOWER]: Advancing to term 5
I20240503 08:12:13.112293 16880 raft_consensus.cc:979] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d: : Instructing follower ca07569acd3c4788a18088342811372f to start an election
I20240503 08:12:13.112462 16880 raft_consensus.cc:1067] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 2 LEADER]: Signalling peer ca07569acd3c4788a18088342811372f to start an election
I20240503 08:12:13.113085 16558 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b"
dest_uuid: "ca07569acd3c4788a18088342811372f"
from {username='slave'} at 127.0.0.1:51818
I20240503 08:12:13.113250 16558 raft_consensus.cc:482] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:13.113369 16558 raft_consensus.cc:3037] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:13.113533 16557 raft_consensus.cc:504] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:13.114151 16557 leader_election.cc:288] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 5 election: Requested vote from peers 1e3692757b61436dade71922df50600d (127.16.10.66:41879), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:12:13.114446 16633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:12:13.114658 16633 raft_consensus.cc:3032] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 4 LEADER]: Stepping down as leader of term 4
I20240503 08:12:13.114778 16706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8156ff16f224413a8aebdc1953ade4fd" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:12:13.114781 16633 raft_consensus.cc:729] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:12:13.114984 16706 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 4 FOLLOWER]: Advancing to term 5
I20240503 08:12:13.115135 16633 consensus_queue.cc:260] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:13.115527 16633 raft_consensus.cc:3037] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 4 FOLLOWER]: Advancing to term 5
I20240503 08:12:13.115904 16558 raft_consensus.cc:504] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:13.116586 16558 leader_election.cc:288] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 3 election: Requested vote from peers 1e3692757b61436dade71922df50600d (127.16.10.66:41879), adf2731df95a4745b333c70360f1df6b (127.16.10.67:42339)
I20240503 08:12:13.117200 16706 raft_consensus.cc:2454] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 5.
I20240503 08:12:13.117837 16523 leader_election.cc:302] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adf2731df95a4745b333c70360f1df6b, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:12:13.117758 16632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e3692757b61436dade71922df50600d"
I20240503 08:12:13.117928 16633 raft_consensus.cc:2454] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 5.
I20240503 08:12:13.118062 16632 raft_consensus.cc:3032] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:12:13.118119 16887 raft_consensus.cc:2781] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 5 FOLLOWER]: Leader election won for term 5
I20240503 08:12:13.118160 16632 raft_consensus.cc:729] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e3692757b61436dade71922df50600d, State: Running, Role: LEADER
I20240503 08:12:13.118295 16887 raft_consensus.cc:686] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 5 LEADER]: Becoming Leader. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:12:13.118340 16706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7581750b4e9741e9834dbd3db34ef33b" candidate_uuid: "ca07569acd3c4788a18088342811372f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adf2731df95a4745b333c70360f1df6b"
I20240503 08:12:13.118489 16706 raft_consensus.cc:3037] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:13.118412 16632 consensus_queue.cc:260] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:13.118592 16887 consensus_queue.cc:237] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:13.118788 16632 raft_consensus.cc:3037] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:13.121021 16632 raft_consensus.cc:2454] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 3.
I20240503 08:12:13.121048 16706 raft_consensus.cc:2454] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca07569acd3c4788a18088342811372f in term 3.
I20240503 08:12:13.121374 16521 leader_election.cc:302] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e3692757b61436dade71922df50600d, ca07569acd3c4788a18088342811372f; no voters:
I20240503 08:12:13.121651 16887 raft_consensus.cc:2781] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:12:13.121783 16887 raft_consensus.cc:686] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 3 LEADER]: Becoming Leader. State: Replica: ca07569acd3c4788a18088342811372f, State: Running, Role: LEADER
I20240503 08:12:13.121996 16887 consensus_queue.cc:237] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } }
I20240503 08:12:13.122045 16455 catalog_manager.cc:5484] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f reported cstate change: term changed from 4 to 5, leader changed from 1e3692757b61436dade71922df50600d (127.16.10.66) to ca07569acd3c4788a18088342811372f (127.16.10.65). New cstate: current_term: 5 leader_uuid: "ca07569acd3c4788a18088342811372f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:13.125985 16455 catalog_manager.cc:5484] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f reported cstate change: term changed from 2 to 3, leader changed from 1e3692757b61436dade71922df50600d (127.16.10.66) to ca07569acd3c4788a18088342811372f (127.16.10.65). New cstate: current_term: 3 leader_uuid: "ca07569acd3c4788a18088342811372f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:13.382647 16632 raft_consensus.cc:1261] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Refusing update from remote peer adf2731df95a4745b333c70360f1df6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:13.383236 16852 consensus_queue.cc:1035] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:13.385694 16558 raft_consensus.cc:1261] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 4 FOLLOWER]: Refusing update from remote peer adf2731df95a4745b333c70360f1df6b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:12:13.386330 16852 consensus_queue.cc:1035] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:13.387710 16557 raft_consensus.cc:1261] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Refusing update from remote peer adf2731df95a4745b333c70360f1df6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:13.388528 16896 consensus_queue.cc:1035] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca07569acd3c4788a18088342811372f" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 42565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:13.394168 16632 raft_consensus.cc:1261] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 4 FOLLOWER]: Refusing update from remote peer adf2731df95a4745b333c70360f1df6b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:12:13.394712 16852 consensus_queue.cc:1035] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:13.472432 16632 raft_consensus.cc:1261] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 4 FOLLOWER]: Refusing update from remote peer ca07569acd3c4788a18088342811372f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:12:13.472976 16887 consensus_queue.cc:1035] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:13.476761 16706 raft_consensus.cc:1261] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 4 FOLLOWER]: Refusing update from remote peer ca07569acd3c4788a18088342811372f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:12:13.477510 16904 consensus_queue.cc:1035] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:13.551193 16706 raft_consensus.cc:1261] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Refusing update from remote peer ca07569acd3c4788a18088342811372f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:13.551729 16904 consensus_queue.cc:1035] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:13.554942 16632 raft_consensus.cc:1261] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Refusing update from remote peer ca07569acd3c4788a18088342811372f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:13.555670 16887 consensus_queue.cc:1035] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:13.641456 16632 raft_consensus.cc:1261] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 5 FOLLOWER]: Refusing update from remote peer ca07569acd3c4788a18088342811372f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240503 08:12:13.642040 16887 consensus_queue.cc:1035] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e3692757b61436dade71922df50600d" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240503 08:12:13.645527 16706 raft_consensus.cc:1261] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 5 FOLLOWER]: Refusing update from remote peer ca07569acd3c4788a18088342811372f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240503 08:12:13.646102 16887 consensus_queue.cc:1035] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf2731df95a4745b333c70360f1df6b" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 42339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240503 08:12:13.824782 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:13.826328 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:13.826519 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:14.826884 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:14.828444 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:14.828615 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:15.829102 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:15.830633 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:15.830842 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:16.842119 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:16.843806 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:16.843963 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:17.844353 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:17.845889 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:17.846050 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:18.846422 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:18.847942 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:18.848094 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:19.848510 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:19.850030 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:19.850183 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:20.850538 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:20.852182 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:20.852319 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:21.852788 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:21.854353 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:21.854539 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:22.864317 16425 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20240503 08:12:22.864626 16425 tablet_server.cc:178] TabletServer@127.16.10.65:0 shutting down...
I20240503 08:12:22.875344 16425 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 08:12:22.875686 16425 tablet_replica.cc:330] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f: stopping tablet replica
I20240503 08:12:22.876153 16425 raft_consensus.cc:2229] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 5 LEADER]: Raft consensus shutting down.
I20240503 08:12:22.876579 16425 raft_consensus.cc:2258] T 8156ff16f224413a8aebdc1953ade4fd P ca07569acd3c4788a18088342811372f [term 5 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.878032 16425 tablet_replica.cc:330] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f: stopping tablet replica
I20240503 08:12:22.878198 16425 raft_consensus.cc:2229] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.878366 16425 raft_consensus.cc:2258] T 19cfbee898db4fd8acf071dd2dc16bc9 P ca07569acd3c4788a18088342811372f [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.878809 16425 tablet_replica.cc:330] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f: stopping tablet replica
I20240503 08:12:22.878942 16425 raft_consensus.cc:2229] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 4 LEADER]: Raft consensus shutting down.
I20240503 08:12:22.879204 16425 raft_consensus.cc:2258] T b33015a162854ad2bf6cda67ddbb0ca5 P ca07569acd3c4788a18088342811372f [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.879655 16425 tablet_replica.cc:330] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f: stopping tablet replica
I20240503 08:12:22.879805 16425 raft_consensus.cc:2229] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.879935 16425 raft_consensus.cc:2258] T f8d9bcc6ca914e379a077bd28ce52b27 P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.880352 16425 tablet_replica.cc:330] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f: stopping tablet replica
I20240503 08:12:22.880478 16425 raft_consensus.cc:2229] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 3 LEADER]: Raft consensus shutting down.
I20240503 08:12:22.880714 16425 raft_consensus.cc:2258] T 7581750b4e9741e9834dbd3db34ef33b P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.881105 16425 tablet_replica.cc:330] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f: stopping tablet replica
I20240503 08:12:22.881244 16425 raft_consensus.cc:2229] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.881376 16425 raft_consensus.cc:2258] T d6353a8d0f274677b6b476eedc789f6f P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.881784 16425 tablet_replica.cc:330] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f: stopping tablet replica
I20240503 08:12:22.881906 16425 raft_consensus.cc:2229] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.882056 16425 raft_consensus.cc:2258] T 59ae9bb05e914e07be3ab9a3d7003b38 P ca07569acd3c4788a18088342811372f [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.882433 16425 tablet_replica.cc:330] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f: stopping tablet replica
I20240503 08:12:22.882572 16425 raft_consensus.cc:2229] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.882699 16425 raft_consensus.cc:2258] T 1aa154e4ac484d529b758e3dd496ecd4 P ca07569acd3c4788a18088342811372f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.883095 16425 tablet_replica.cc:330] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f: stopping tablet replica
I20240503 08:12:22.883211 16425 raft_consensus.cc:2229] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.883352 16425 raft_consensus.cc:2258] T 3f4e21092f9746209444c8f5b7f5964d P ca07569acd3c4788a18088342811372f [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.900493 16425 tablet_server.cc:194] TabletServer@127.16.10.65:0 shutdown complete.
I20240503 08:12:22.907433 16425 tablet_server.cc:178] TabletServer@127.16.10.66:0 shutting down...
I20240503 08:12:22.916307 16425 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 08:12:22.916566 16425 tablet_replica.cc:330] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d: stopping tablet replica
I20240503 08:12:22.916754 16425 raft_consensus.cc:2229] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.916961 16425 raft_consensus.cc:2258] T b33015a162854ad2bf6cda67ddbb0ca5 P 1e3692757b61436dade71922df50600d [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.917546 16425 tablet_replica.cc:330] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d: stopping tablet replica
I20240503 08:12:22.917702 16425 raft_consensus.cc:2229] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.917850 16425 raft_consensus.cc:2258] T d6353a8d0f274677b6b476eedc789f6f P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.918401 16425 tablet_replica.cc:330] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d: stopping tablet replica
I20240503 08:12:22.918557 16425 raft_consensus.cc:2229] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Raft consensus shutting down.
I20240503 08:12:22.918843 16425 raft_consensus.cc:2258] T 3f4e21092f9746209444c8f5b7f5964d P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.919296 16425 tablet_replica.cc:330] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d: stopping tablet replica
I20240503 08:12:22.919471 16425 raft_consensus.cc:2229] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 5 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.919612 16425 raft_consensus.cc:2258] T 8156ff16f224413a8aebdc1953ade4fd P 1e3692757b61436dade71922df50600d [term 5 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.920040 16425 tablet_replica.cc:330] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d: stopping tablet replica
I20240503 08:12:22.920172 16425 raft_consensus.cc:2229] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.920316 16425 raft_consensus.cc:2258] T 7581750b4e9741e9834dbd3db34ef33b P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.920696 16425 tablet_replica.cc:330] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d: stopping tablet replica
I20240503 08:12:22.920832 16425 raft_consensus.cc:2229] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 3 LEADER]: Raft consensus shutting down.
I20240503 08:12:22.921068 16425 raft_consensus.cc:2258] T f8d9bcc6ca914e379a077bd28ce52b27 P 1e3692757b61436dade71922df50600d [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.921468 16425 tablet_replica.cc:330] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d: stopping tablet replica
I20240503 08:12:22.921592 16425 raft_consensus.cc:2229] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.921730 16425 raft_consensus.cc:2258] T 19cfbee898db4fd8acf071dd2dc16bc9 P 1e3692757b61436dade71922df50600d [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.922109 16425 tablet_replica.cc:330] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d: stopping tablet replica
I20240503 08:12:22.922246 16425 raft_consensus.cc:2229] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 1 LEADER]: Raft consensus shutting down.
I20240503 08:12:22.922464 16425 raft_consensus.cc:2258] T 1aa154e4ac484d529b758e3dd496ecd4 P 1e3692757b61436dade71922df50600d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.922858 16425 tablet_replica.cc:330] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d: stopping tablet replica
I20240503 08:12:22.922983 16425 raft_consensus.cc:2229] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.923128 16425 raft_consensus.cc:2258] T 59ae9bb05e914e07be3ab9a3d7003b38 P 1e3692757b61436dade71922df50600d [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.939065 16425 tablet_server.cc:194] TabletServer@127.16.10.66:0 shutdown complete.
I20240503 08:12:22.943084 16425 tablet_server.cc:178] TabletServer@127.16.10.67:0 shutting down...
I20240503 08:12:22.952379 16425 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 08:12:22.952634 16425 tablet_replica.cc:330] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b: stopping tablet replica
I20240503 08:12:22.952816 16425 raft_consensus.cc:2229] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.953030 16425 raft_consensus.cc:2258] T 3f4e21092f9746209444c8f5b7f5964d P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.953580 16425 tablet_replica.cc:330] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b: stopping tablet replica
I20240503 08:12:22.953740 16425 raft_consensus.cc:2229] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 4 LEADER]: Raft consensus shutting down.
I20240503 08:12:22.954022 16425 raft_consensus.cc:2258] T 19cfbee898db4fd8acf071dd2dc16bc9 P adf2731df95a4745b333c70360f1df6b [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.954469 16425 tablet_replica.cc:330] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b: stopping tablet replica
I20240503 08:12:22.954607 16425 raft_consensus.cc:2229] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.954756 16425 raft_consensus.cc:2258] T b33015a162854ad2bf6cda67ddbb0ca5 P adf2731df95a4745b333c70360f1df6b [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.955166 16425 tablet_replica.cc:330] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b: stopping tablet replica
I20240503 08:12:22.955309 16425 raft_consensus.cc:2229] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:12:22.955559 16425 raft_consensus.cc:2258] T 59ae9bb05e914e07be3ab9a3d7003b38 P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.955974 16425 tablet_replica.cc:330] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b: stopping tablet replica
I20240503 08:12:22.956101 16425 raft_consensus.cc:2229] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.956244 16425 raft_consensus.cc:2258] T 1aa154e4ac484d529b758e3dd496ecd4 P adf2731df95a4745b333c70360f1df6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.956633 16425 tablet_replica.cc:330] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b: stopping tablet replica
I20240503 08:12:22.956776 16425 raft_consensus.cc:2229] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:12:22.957006 16425 raft_consensus.cc:2258] T d6353a8d0f274677b6b476eedc789f6f P adf2731df95a4745b333c70360f1df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.957410 16425 tablet_replica.cc:330] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b: stopping tablet replica
I20240503 08:12:22.957542 16425 raft_consensus.cc:2229] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.957690 16425 raft_consensus.cc:2258] T 7581750b4e9741e9834dbd3db34ef33b P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.958074 16425 tablet_replica.cc:330] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b: stopping tablet replica
I20240503 08:12:22.958209 16425 raft_consensus.cc:2229] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.958344 16425 raft_consensus.cc:2258] T f8d9bcc6ca914e379a077bd28ce52b27 P adf2731df95a4745b333c70360f1df6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.958729 16425 tablet_replica.cc:330] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b: stopping tablet replica
I20240503 08:12:22.958847 16425 raft_consensus.cc:2229] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 5 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:22.958997 16425 raft_consensus.cc:2258] T 8156ff16f224413a8aebdc1953ade4fd P adf2731df95a4745b333c70360f1df6b [term 5 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.974819 16425 tablet_server.cc:194] TabletServer@127.16.10.67:0 shutdown complete.
I20240503 08:12:22.979097 16425 master.cc:537] Master@127.16.10.126:45713 shutting down...
I20240503 08:12:22.987125 16425 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [term 1 LEADER]: Raft consensus shutting down.
I20240503 08:12:22.987391 16425 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:22.987558 16425 tablet_replica.cc:330] T 00000000000000000000000000000000 P 143540eeaac5475a845926273306044f: stopping tablet replica
I20240503 08:12:23.001624 16425 master.cc:552] Master@127.16.10.126:45713 shutdown complete.
1e3692757b61436dade71922df50600d 4
adf2731df95a4745b333c70360f1df6b 1
ca07569acd3c4788a18088342811372f 4
1e3692757b61436dade71922df50600d 3
adf2731df95a4745b333c70360f1df6b 3
ca07569acd3c4788a18088342811372f 3
1e3692757b61436dade71922df50600d 8
adf2731df95a4745b333c70360f1df6b 1
ca07569acd3c4788a18088342811372f 0
1e3692757b61436dade71922df50600d 3
adf2731df95a4745b333c70360f1df6b 3
ca07569acd3c4788a18088342811372f 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (27275 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20240503 08:12:23.019570 16425 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.10.126:41683
I20240503 08:12:23.020162 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:12:23.023231 16915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:23.023766 16916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:23.024272 16918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:12:23.025099 16425 server_base.cc:1034] running on GCE node
I20240503 08:12:23.025394 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:12:23.025451 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:12:23.025502 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723943025478 us; error 0 us; skew 500 ppm
I20240503 08:12:23.025650 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:12:23.030560 16425 webserver.cc:460] Webserver started at http://127.16.10.126:46279/ using document root <none> and password file <none>
I20240503 08:12:23.030792 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:12:23.030869 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:12:23.030989 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:12:23.031886 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/master-0-root/instance:
uuid: "017f7fffcfcf43b296aa9382d498a895"
format_stamp: "Formatted at 2024-05-03 08:12:23 on dist-test-slave-6p8x"
I20240503 08:12:23.034325 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:23.035981 16923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:23.036319 16425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:12:23.036427 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/master-0-root
uuid: "017f7fffcfcf43b296aa9382d498a895"
format_stamp: "Formatted at 2024-05-03 08:12:23 on dist-test-slave-6p8x"
I20240503 08:12:23.036559 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:12:23.050825 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:12:23.051427 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:12:23.064909 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.126:41683
I20240503 08:12:23.064947 16974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.126:41683 every 8 connection(s)
I20240503 08:12:23.066262 16975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.070235 16975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895: Bootstrap starting.
I20240503 08:12:23.071516 16975 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.073010 16975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895: No bootstrap required, opened a new log
I20240503 08:12:23.073637 16975 raft_consensus.cc:348] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017f7fffcfcf43b296aa9382d498a895" member_type: VOTER }
I20240503 08:12:23.073767 16975 raft_consensus.cc:374] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.073850 16975 raft_consensus.cc:729] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017f7fffcfcf43b296aa9382d498a895, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.074060 16975 consensus_queue.cc:260] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017f7fffcfcf43b296aa9382d498a895" member_type: VOTER }
I20240503 08:12:23.074213 16975 raft_consensus.cc:388] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:12:23.074287 16975 raft_consensus.cc:482] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:12:23.074393 16975 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.076113 16975 raft_consensus.cc:504] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017f7fffcfcf43b296aa9382d498a895" member_type: VOTER }
I20240503 08:12:23.076331 16975 leader_election.cc:302] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 017f7fffcfcf43b296aa9382d498a895; no voters:
I20240503 08:12:23.076711 16975 leader_election.cc:288] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:12:23.076851 16978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:23.077702 16975 sys_catalog.cc:564] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:12:23.077790 16978 raft_consensus.cc:686] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [term 1 LEADER]: Becoming Leader. State: Replica: 017f7fffcfcf43b296aa9382d498a895, State: Running, Role: LEADER
I20240503 08:12:23.078078 16978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017f7fffcfcf43b296aa9382d498a895" member_type: VOTER }
I20240503 08:12:23.078822 16980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 017f7fffcfcf43b296aa9382d498a895. Latest consensus state: current_term: 1 leader_uuid: "017f7fffcfcf43b296aa9382d498a895" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017f7fffcfcf43b296aa9382d498a895" member_type: VOTER } }
I20240503 08:12:23.079066 16980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [sys.catalog]: This master's current role is: LEADER
I20240503 08:12:23.079524 16979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "017f7fffcfcf43b296aa9382d498a895" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017f7fffcfcf43b296aa9382d498a895" member_type: VOTER } }
I20240503 08:12:23.079711 16979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [sys.catalog]: This master's current role is: LEADER
I20240503 08:12:23.080264 16984 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:12:23.082657 16984 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:12:23.083070 16425 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240503 08:12:23.085601 16984 catalog_manager.cc:1347] Generated new cluster ID: 28956280a9b74d138655089bb0153ef9
I20240503 08:12:23.085680 16984 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:12:23.094516 16984 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:12:23.095602 16984 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:12:23.105335 16984 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895: Generated new TSK 0
I20240503 08:12:23.105566 16984 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:12:23.116159 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:12:23.119477 16996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:23.120008 16997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:23.120433 16999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:12:23.120918 16425 server_base.cc:1034] running on GCE node
I20240503 08:12:23.121155 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:12:23.121222 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:12:23.121263 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723943121249 us; error 0 us; skew 500 ppm
I20240503 08:12:23.121392 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:12:23.122560 16425 webserver.cc:460] Webserver started at http://127.16.10.65:36773/ using document root <none> and password file <none>
I20240503 08:12:23.122782 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:12:23.122848 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:12:23.122977 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:12:23.123649 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-0-root/instance:
uuid: "adf8f413c64f4c2389e9389dd2b638c7"
format_stamp: "Formatted at 2024-05-03 08:12:23 on dist-test-slave-6p8x"
I20240503 08:12:23.126138 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20240503 08:12:23.127760 17004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:23.128139 16425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240503 08:12:23.128237 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-0-root
uuid: "adf8f413c64f4c2389e9389dd2b638c7"
format_stamp: "Formatted at 2024-05-03 08:12:23 on dist-test-slave-6p8x"
I20240503 08:12:23.128348 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:12:23.136782 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:12:23.137341 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:12:23.137831 16425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:12:23.138651 16425 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:12:23.138721 16425 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:23.138792 16425 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:12:23.138844 16425 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:23.153070 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.65:39509
I20240503 08:12:23.153110 17066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.65:39509 every 8 connection(s)
I20240503 08:12:23.154629 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:12:23.158530 17072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:23.158969 17071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:12:23.159673 16425 server_base.cc:1034] running on GCE node
W20240503 08:12:23.160995 17075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:12:23.161397 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:12:23.161477 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:12:23.161545 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723943161510 us; error 0 us; skew 500 ppm
I20240503 08:12:23.161715 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:12:23.162909 17067 heartbeater.cc:347] Connected to a master server at 127.16.10.126:41683
I20240503 08:12:23.163059 17067 heartbeater.cc:464] Registering TS with master...
I20240503 08:12:23.163064 16425 webserver.cc:460] Webserver started at http://127.16.10.66:35407/ using document root <none> and password file <none>
I20240503 08:12:23.163340 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:12:23.163483 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:12:23.163545 17067 heartbeater.cc:511] Master 127.16.10.126:41683 requested a full tablet report, sending...
I20240503 08:12:23.163635 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:12:23.164399 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-1-root/instance:
uuid: "9ad100ff3b5049f3966c923497e18f06"
format_stamp: "Formatted at 2024-05-03 08:12:23 on dist-test-slave-6p8x"
I20240503 08:12:23.164536 16940 ts_manager.cc:194] Registered new tserver with Master: adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509)
I20240503 08:12:23.165596 16940 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56680
I20240503 08:12:23.167194 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240503 08:12:23.168840 17079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:23.169194 16425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:12:23.169306 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-1-root
uuid: "9ad100ff3b5049f3966c923497e18f06"
format_stamp: "Formatted at 2024-05-03 08:12:23 on dist-test-slave-6p8x"
I20240503 08:12:23.169438 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:12:23.180140 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:12:23.180807 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:12:23.181392 16425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:12:23.182204 16425 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:12:23.182271 16425 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:23.182371 16425 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:12:23.182422 16425 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:23.197945 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.66:44441
I20240503 08:12:23.197989 17141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.66:44441 every 8 connection(s)
I20240503 08:12:23.199617 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:12:23.203398 17145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:23.205983 17146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:12:23.207754 17142 heartbeater.cc:347] Connected to a master server at 127.16.10.126:41683
I20240503 08:12:23.207890 17142 heartbeater.cc:464] Registering TS with master...
I20240503 08:12:23.208318 17142 heartbeater.cc:511] Master 127.16.10.126:41683 requested a full tablet report, sending...
W20240503 08:12:23.208534 17148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:12:23.209190 16425 server_base.cc:1034] running on GCE node
I20240503 08:12:23.209347 16940 ts_manager.cc:194] Registered new tserver with Master: 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:23.209456 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:12:23.209553 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:12:23.209612 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723943209593 us; error 0 us; skew 500 ppm
I20240503 08:12:23.209782 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:12:23.210484 16940 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56688
I20240503 08:12:23.211593 16425 webserver.cc:460] Webserver started at http://127.16.10.67:34995/ using document root <none> and password file <none>
I20240503 08:12:23.211849 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:12:23.211933 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:12:23.212071 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:12:23.212690 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-2-root/instance:
uuid: "129772b7c12040808cb9a9fbf09c95c8"
format_stamp: "Formatted at 2024-05-03 08:12:23 on dist-test-slave-6p8x"
I20240503 08:12:23.215195 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240503 08:12:23.216856 17153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:23.217206 16425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:12:23.217329 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-2-root
uuid: "129772b7c12040808cb9a9fbf09c95c8"
format_stamp: "Formatted at 2024-05-03 08:12:23 on dist-test-slave-6p8x"
I20240503 08:12:23.217444 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714723915676718-16425-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:12:23.241346 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:12:23.241950 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:12:23.242574 16425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:12:23.243569 16425 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:12:23.243662 16425 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:23.243768 16425 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:12:23.243837 16425 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:23.260545 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.67:40555
I20240503 08:12:23.260617 17215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.67:40555 every 8 connection(s)
I20240503 08:12:23.268285 17216 heartbeater.cc:347] Connected to a master server at 127.16.10.126:41683
I20240503 08:12:23.268435 17216 heartbeater.cc:464] Registering TS with master...
I20240503 08:12:23.268811 17216 heartbeater.cc:511] Master 127.16.10.126:41683 requested a full tablet report, sending...
I20240503 08:12:23.269630 16940 ts_manager.cc:194] Registered new tserver with Master: 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.270341 16425 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.007960517s
I20240503 08:12:23.270529 16940 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56690
I20240503 08:12:23.271790 16425 test_util.cc:268] Using random seed: 1200016733
I20240503 08:12:23.284994 16940 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56704:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240503 08:12:23.285868 16940 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240503 08:12:23.314529 17032 tablet_service.cc:1467] Processing CreateTablet for tablet 8fb4aa868b8642378606d84949c3559c (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240503 08:12:23.314900 17030 tablet_service.cc:1467] Processing CreateTablet for tablet 810966f2a982466ca03159edc4b4b35d (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240503 08:12:23.315048 17026 tablet_service.cc:1467] Processing CreateTablet for tablet 28fa7c15a1924e0d87ec1a5dbc01a60c (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240503 08:12:23.315217 17032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fb4aa868b8642378606d84949c3559c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.315428 17029 tablet_service.cc:1467] Processing CreateTablet for tablet 4f5aecc555e9496eba7f9bc5d67bdbd1 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240503 08:12:23.315570 17026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28fa7c15a1924e0d87ec1a5dbc01a60c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.315745 17028 tablet_service.cc:1467] Processing CreateTablet for tablet 9da6d226e790440eb97f22ade721af57 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240503 08:12:23.315858 17029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f5aecc555e9496eba7f9bc5d67bdbd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.316162 17028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da6d226e790440eb97f22ade721af57. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.316551 17024 tablet_service.cc:1467] Processing CreateTablet for tablet 98deac96b39c4913a453310aef642721 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240503 08:12:23.316944 17024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98deac96b39c4913a453310aef642721. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.320226 17178 tablet_service.cc:1467] Processing CreateTablet for tablet 4f5aecc555e9496eba7f9bc5d67bdbd1 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240503 08:12:23.320559 17025 tablet_service.cc:1467] Processing CreateTablet for tablet 2c52979c9d154024a1940cfd04b0ecd5 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240503 08:12:23.320780 17178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f5aecc555e9496eba7f9bc5d67bdbd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.321053 17025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c52979c9d154024a1940cfd04b0ecd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.323863 17176 tablet_service.cc:1467] Processing CreateTablet for tablet 8d3aed7f93894ea1a6edafb5fc4b6632 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240503 08:12:23.324463 17176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d3aed7f93894ea1a6edafb5fc4b6632. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.325882 17030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 810966f2a982466ca03159edc4b4b35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.329057 17181 tablet_service.cc:1467] Processing CreateTablet for tablet 8fb4aa868b8642378606d84949c3559c (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240503 08:12:23.329238 17177 tablet_service.cc:1467] Processing CreateTablet for tablet 9da6d226e790440eb97f22ade721af57 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240503 08:12:23.329478 17175 tablet_service.cc:1467] Processing CreateTablet for tablet 28fa7c15a1924e0d87ec1a5dbc01a60c (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240503 08:12:23.329634 17181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fb4aa868b8642378606d84949c3559c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.329747 17173 tablet_service.cc:1467] Processing CreateTablet for tablet 98deac96b39c4913a453310aef642721 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240503 08:12:23.330020 17027 tablet_service.cc:1467] Processing CreateTablet for tablet 8d3aed7f93894ea1a6edafb5fc4b6632 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240503 08:12:23.330427 17027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d3aed7f93894ea1a6edafb5fc4b6632. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.335498 17031 tablet_service.cc:1467] Processing CreateTablet for tablet d0ddeaed6b6b46fa8fb5de4cc6b1593d (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240503 08:12:23.335548 17172 tablet_service.cc:1467] Processing CreateTablet for tablet d4f2725a98274d7e85fdfd2c1bc8df10 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240503 08:12:23.329102 17179 tablet_service.cc:1467] Processing CreateTablet for tablet 810966f2a982466ca03159edc4b4b35d (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240503 08:12:23.336030 17174 tablet_service.cc:1467] Processing CreateTablet for tablet 2c52979c9d154024a1940cfd04b0ecd5 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240503 08:12:23.336534 17175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28fa7c15a1924e0d87ec1a5dbc01a60c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.336041 17031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0ddeaed6b6b46fa8fb5de4cc6b1593d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.336957 17023 tablet_service.cc:1467] Processing CreateTablet for tablet d4f2725a98274d7e85fdfd2c1bc8df10 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240503 08:12:23.336413 17180 tablet_service.cc:1467] Processing CreateTablet for tablet d0ddeaed6b6b46fa8fb5de4cc6b1593d (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240503 08:12:23.337594 17023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4f2725a98274d7e85fdfd2c1bc8df10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.341414 17180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0ddeaed6b6b46fa8fb5de4cc6b1593d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.344391 17179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 810966f2a982466ca03159edc4b4b35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.348361 17174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c52979c9d154024a1940cfd04b0ecd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.349440 17173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98deac96b39c4913a453310aef642721. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.354693 17177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da6d226e790440eb97f22ade721af57. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.368425 17172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4f2725a98274d7e85fdfd2c1bc8df10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.373178 17106 tablet_service.cc:1467] Processing CreateTablet for tablet d0ddeaed6b6b46fa8fb5de4cc6b1593d (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240503 08:12:23.376219 17107 tablet_service.cc:1467] Processing CreateTablet for tablet 8fb4aa868b8642378606d84949c3559c (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240503 08:12:23.380514 17106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0ddeaed6b6b46fa8fb5de4cc6b1593d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.381345 17231 tablet_bootstrap.cc:492] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7: Bootstrap starting.
I20240503 08:12:23.382251 17107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fb4aa868b8642378606d84949c3559c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.382544 17232 tablet_bootstrap.cc:492] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8: Bootstrap starting.
I20240503 08:12:23.382328 17103 tablet_service.cc:1467] Processing CreateTablet for tablet 9da6d226e790440eb97f22ade721af57 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240503 08:12:23.381479 17102 tablet_service.cc:1467] Processing CreateTablet for tablet 8d3aed7f93894ea1a6edafb5fc4b6632 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240503 08:12:23.385836 17100 tablet_service.cc:1467] Processing CreateTablet for tablet 2c52979c9d154024a1940cfd04b0ecd5 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240503 08:12:23.385767 17105 tablet_service.cc:1467] Processing CreateTablet for tablet 810966f2a982466ca03159edc4b4b35d (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240503 08:12:23.385049 17104 tablet_service.cc:1467] Processing CreateTablet for tablet 4f5aecc555e9496eba7f9bc5d67bdbd1 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240503 08:12:23.386978 17099 tablet_service.cc:1467] Processing CreateTablet for tablet 98deac96b39c4913a453310aef642721 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240503 08:12:23.386682 17101 tablet_service.cc:1467] Processing CreateTablet for tablet 28fa7c15a1924e0d87ec1a5dbc01a60c (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240503 08:12:23.389315 17103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da6d226e790440eb97f22ade721af57. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.392292 17102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d3aed7f93894ea1a6edafb5fc4b6632. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.389230 17098 tablet_service.cc:1467] Processing CreateTablet for tablet d4f2725a98274d7e85fdfd2c1bc8df10 (DEFAULT_TABLE table=test-workload [id=54b91ea3f09e42faa530c462a9a1f680]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240503 08:12:23.393600 17100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c52979c9d154024a1940cfd04b0ecd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.393867 17098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4f2725a98274d7e85fdfd2c1bc8df10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.397297 17101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28fa7c15a1924e0d87ec1a5dbc01a60c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.398521 17105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 810966f2a982466ca03159edc4b4b35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.398808 17099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98deac96b39c4913a453310aef642721. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.400770 17104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f5aecc555e9496eba7f9bc5d67bdbd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:23.445662 17231 tablet_bootstrap.cc:654] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.446377 17232 tablet_bootstrap.cc:654] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.448829 17233 tablet_bootstrap.cc:492] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06: Bootstrap starting.
I20240503 08:12:23.451637 17233 tablet_bootstrap.cc:654] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.453435 17231 tablet_bootstrap.cc:492] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7: No bootstrap required, opened a new log
I20240503 08:12:23.453619 17231 ts_tablet_manager.cc:1367] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7: Time spent bootstrapping tablet: real 0.077s user 0.003s sys 0.008s
I20240503 08:12:23.454450 17232 tablet_bootstrap.cc:492] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8: No bootstrap required, opened a new log
I20240503 08:12:23.454587 17232 ts_tablet_manager.cc:1367] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8: Time spent bootstrapping tablet: real 0.078s user 0.003s sys 0.008s
I20240503 08:12:23.454532 17231 raft_consensus.cc:348] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.454783 17231 raft_consensus.cc:374] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.454888 17231 raft_consensus.cc:729] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.455178 17231 consensus_queue.cc:260] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.455288 17232 raft_consensus.cc:348] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } } peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } }
I20240503 08:12:23.455499 17232 raft_consensus.cc:374] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.455593 17232 raft_consensus.cc:729] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.455816 17232 consensus_queue.cc:260] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } } peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } }
I20240503 08:12:23.456604 17216 heartbeater.cc:503] Master 127.16.10.126:41683 was elected leader, sending a full tablet report...
I20240503 08:12:23.456604 17232 ts_tablet_manager.cc:1398] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:23.457712 17232 tablet_bootstrap.cc:492] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8: Bootstrap starting.
I20240503 08:12:23.460978 17233 tablet_bootstrap.cc:492] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06: No bootstrap required, opened a new log
I20240503 08:12:23.461225 17233 ts_tablet_manager.cc:1367] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.011s
I20240503 08:12:23.461586 17232 tablet_bootstrap.cc:654] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.462141 17231 ts_tablet_manager.cc:1398] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7: Time spent starting tablet: real 0.008s user 0.004s sys 0.005s
I20240503 08:12:23.462388 17067 heartbeater.cc:503] Master 127.16.10.126:41683 was elected leader, sending a full tablet report...
I20240503 08:12:23.462493 17233 raft_consensus.cc:348] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.462723 17233 raft_consensus.cc:374] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.462826 17233 raft_consensus.cc:729] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.463101 17233 consensus_queue.cc:260] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.468407 17142 heartbeater.cc:503] Master 127.16.10.126:41683 was elected leader, sending a full tablet report...
I20240503 08:12:23.468487 17233 ts_tablet_manager.cc:1398] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20240503 08:12:23.468744 17233 tablet_bootstrap.cc:492] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06: Bootstrap starting.
I20240503 08:12:23.468797 17232 tablet_bootstrap.cc:492] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8: No bootstrap required, opened a new log
I20240503 08:12:23.468945 17232 ts_tablet_manager.cc:1367] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.003s
I20240503 08:12:23.469568 17231 tablet_bootstrap.cc:492] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7: Bootstrap starting.
I20240503 08:12:23.470054 17232 raft_consensus.cc:348] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.470331 17232 raft_consensus.cc:374] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.470423 17232 raft_consensus.cc:729] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.470683 17233 tablet_bootstrap.cc:654] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.470752 17232 consensus_queue.cc:260] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.471750 17231 tablet_bootstrap.cc:654] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.472326 17232 ts_tablet_manager.cc:1398] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20240503 08:12:23.472759 17232 tablet_bootstrap.cc:492] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8: Bootstrap starting.
I20240503 08:12:23.475939 17232 tablet_bootstrap.cc:654] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.476982 17233 tablet_bootstrap.cc:492] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06: No bootstrap required, opened a new log
I20240503 08:12:23.477198 17233 ts_tablet_manager.cc:1367] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20240503 08:12:23.478058 17233 raft_consensus.cc:348] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.478365 17233 raft_consensus.cc:374] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.478453 17233 raft_consensus.cc:729] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.478745 17233 consensus_queue.cc:260] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.479435 17233 ts_tablet_manager.cc:1398] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:12:23.479734 17233 tablet_bootstrap.cc:492] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06: Bootstrap starting.
I20240503 08:12:23.480365 17231 tablet_bootstrap.cc:492] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7: No bootstrap required, opened a new log
I20240503 08:12:23.480589 17231 ts_tablet_manager.cc:1367] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.002s
I20240503 08:12:23.481755 17233 tablet_bootstrap.cc:654] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.481643 17231 raft_consensus.cc:348] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } } peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } }
I20240503 08:12:23.482017 17231 raft_consensus.cc:374] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.482157 17231 raft_consensus.cc:729] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.482499 17231 consensus_queue.cc:260] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } } peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } }
I20240503 08:12:23.483191 17231 ts_tablet_manager.cc:1398] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:23.483551 17231 tablet_bootstrap.cc:492] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7: Bootstrap starting.
I20240503 08:12:23.485249 17231 tablet_bootstrap.cc:654] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.487011 17232 tablet_bootstrap.cc:492] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8: No bootstrap required, opened a new log
I20240503 08:12:23.487170 17232 ts_tablet_manager.cc:1367] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20240503 08:12:23.487737 17231 tablet_bootstrap.cc:492] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7: No bootstrap required, opened a new log
I20240503 08:12:23.487897 17231 ts_tablet_manager.cc:1367] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.001s
I20240503 08:12:23.488711 17232 raft_consensus.cc:348] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.488930 17232 raft_consensus.cc:374] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.489054 17233 tablet_bootstrap.cc:492] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06: No bootstrap required, opened a new log
I20240503 08:12:23.489096 17232 raft_consensus.cc:729] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.489216 17233 ts_tablet_manager.cc:1367] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20240503 08:12:23.489219 17231 raft_consensus.cc:348] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.489444 17231 raft_consensus.cc:374] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.489374 17232 consensus_queue.cc:260] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.489535 17231 raft_consensus.cc:729] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.489900 17232 ts_tablet_manager.cc:1398] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:12:23.489801 17231 consensus_queue.cc:260] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.489982 17233 raft_consensus.cc:348] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.490200 17233 raft_consensus.cc:374] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.490226 17232 tablet_bootstrap.cc:492] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8: Bootstrap starting.
I20240503 08:12:23.490299 17233 raft_consensus.cc:729] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.490556 17233 consensus_queue.cc:260] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.491735 17233 ts_tablet_manager.cc:1398] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:23.491887 17231 ts_tablet_manager.cc:1398] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240503 08:12:23.492012 17232 tablet_bootstrap.cc:654] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.492024 17233 tablet_bootstrap.cc:492] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06: Bootstrap starting.
I20240503 08:12:23.492164 17231 tablet_bootstrap.cc:492] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7: Bootstrap starting.
I20240503 08:12:23.493917 17233 tablet_bootstrap.cc:654] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.493995 17231 tablet_bootstrap.cc:654] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.502276 17232 tablet_bootstrap.cc:492] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8: No bootstrap required, opened a new log
I20240503 08:12:23.502454 17232 ts_tablet_manager.cc:1367] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20240503 08:12:23.502525 17233 tablet_bootstrap.cc:492] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06: No bootstrap required, opened a new log
I20240503 08:12:23.502664 17233 ts_tablet_manager.cc:1367] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20240503 08:12:23.503093 17231 tablet_bootstrap.cc:492] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7: No bootstrap required, opened a new log
I20240503 08:12:23.503319 17231 ts_tablet_manager.cc:1367] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20240503 08:12:23.503320 17233 raft_consensus.cc:348] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } } peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } }
I20240503 08:12:23.503319 17232 raft_consensus.cc:348] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.503621 17233 raft_consensus.cc:374] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.503687 17232 raft_consensus.cc:374] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.503710 17233 raft_consensus.cc:729] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.503790 17232 raft_consensus.cc:729] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.503984 17233 consensus_queue.cc:260] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } } peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } }
I20240503 08:12:23.504112 17231 raft_consensus.cc:348] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.504117 17232 consensus_queue.cc:260] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.504331 17231 raft_consensus.cc:374] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.504410 17231 raft_consensus.cc:729] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.504729 17233 ts_tablet_manager.cc:1398] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:12:23.504657 17231 consensus_queue.cc:260] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.505023 17233 tablet_bootstrap.cc:492] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06: Bootstrap starting.
I20240503 08:12:23.505370 17232 ts_tablet_manager.cc:1398] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20240503 08:12:23.505668 17232 tablet_bootstrap.cc:492] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8: Bootstrap starting.
I20240503 08:12:23.506296 17231 ts_tablet_manager.cc:1398] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:12:23.506589 17231 tablet_bootstrap.cc:492] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7: Bootstrap starting.
I20240503 08:12:23.506824 17233 tablet_bootstrap.cc:654] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.507289 17232 tablet_bootstrap.cc:654] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.510798 17231 tablet_bootstrap.cc:654] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.513793 17233 tablet_bootstrap.cc:492] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06: No bootstrap required, opened a new log
I20240503 08:12:23.513934 17232 tablet_bootstrap.cc:492] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8: No bootstrap required, opened a new log
I20240503 08:12:23.513952 17233 ts_tablet_manager.cc:1367] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20240503 08:12:23.514122 17232 ts_tablet_manager.cc:1367] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20240503 08:12:23.514719 17233 raft_consensus.cc:348] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.514897 17233 raft_consensus.cc:374] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.515010 17233 raft_consensus.cc:729] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.514935 17232 raft_consensus.cc:348] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.515182 17232 raft_consensus.cc:374] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.515287 17232 raft_consensus.cc:729] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.515246 17233 consensus_queue.cc:260] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.515537 17232 consensus_queue.cc:260] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.515843 17233 ts_tablet_manager.cc:1398] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:23.516310 17233 tablet_bootstrap.cc:492] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06: Bootstrap starting.
I20240503 08:12:23.516525 17232 ts_tablet_manager.cc:1398] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20240503 08:12:23.516796 17232 tablet_bootstrap.cc:492] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8: Bootstrap starting.
I20240503 08:12:23.518581 17233 tablet_bootstrap.cc:654] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.518823 17231 tablet_bootstrap.cc:492] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7: No bootstrap required, opened a new log
I20240503 08:12:23.519022 17231 ts_tablet_manager.cc:1367] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.005s
I20240503 08:12:23.519027 17232 tablet_bootstrap.cc:654] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.519956 17231 raft_consensus.cc:348] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.520197 17231 raft_consensus.cc:374] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.520318 17231 raft_consensus.cc:729] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.520596 17231 consensus_queue.cc:260] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.521162 17231 ts_tablet_manager.cc:1398] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:12:23.521479 17231 tablet_bootstrap.cc:492] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7: Bootstrap starting.
I20240503 08:12:23.523105 17231 tablet_bootstrap.cc:654] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.526499 17233 tablet_bootstrap.cc:492] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06: No bootstrap required, opened a new log
I20240503 08:12:23.526669 17233 ts_tablet_manager.cc:1367] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20240503 08:12:23.526988 17232 tablet_bootstrap.cc:492] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8: No bootstrap required, opened a new log
I20240503 08:12:23.527145 17232 ts_tablet_manager.cc:1367] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20240503 08:12:23.527469 17233 raft_consensus.cc:348] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.527696 17233 raft_consensus.cc:374] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.527810 17233 raft_consensus.cc:729] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.527912 17232 raft_consensus.cc:348] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.528138 17232 raft_consensus.cc:374] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.528252 17232 raft_consensus.cc:729] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.528167 17233 consensus_queue.cc:260] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.528559 17231 tablet_bootstrap.cc:492] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7: No bootstrap required, opened a new log
I20240503 08:12:23.528688 17233 ts_tablet_manager.cc:1398] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:23.528509 17232 consensus_queue.cc:260] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.528741 17231 ts_tablet_manager.cc:1367] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20240503 08:12:23.529000 17233 tablet_bootstrap.cc:492] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06: Bootstrap starting.
I20240503 08:12:23.529528 17231 raft_consensus.cc:348] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.529735 17231 raft_consensus.cc:374] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.530309 17231 raft_consensus.cc:729] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.530326 17232 ts_tablet_manager.cc:1398] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20240503 08:12:23.530627 17231 consensus_queue.cc:260] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.530740 17232 tablet_bootstrap.cc:492] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8: Bootstrap starting.
I20240503 08:12:23.531121 17231 ts_tablet_manager.cc:1398] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:12:23.531174 17233 tablet_bootstrap.cc:654] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.531462 17231 tablet_bootstrap.cc:492] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7: Bootstrap starting.
I20240503 08:12:23.533035 17231 tablet_bootstrap.cc:654] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.534227 17232 tablet_bootstrap.cc:654] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.541254 17233 tablet_bootstrap.cc:492] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06: No bootstrap required, opened a new log
I20240503 08:12:23.541303 17231 tablet_bootstrap.cc:492] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7: No bootstrap required, opened a new log
I20240503 08:12:23.541278 17232 tablet_bootstrap.cc:492] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8: No bootstrap required, opened a new log
I20240503 08:12:23.541450 17231 ts_tablet_manager.cc:1367] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.007s
I20240503 08:12:23.541533 17232 ts_tablet_manager.cc:1367] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20240503 08:12:23.542685 17231 raft_consensus.cc:348] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.542704 17232 raft_consensus.cc:348] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.542867 17231 raft_consensus.cc:374] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.542886 17232 raft_consensus.cc:374] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.542964 17231 raft_consensus.cc:729] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.542981 17232 raft_consensus.cc:729] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.543192 17231 consensus_queue.cc:260] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.543196 17232 consensus_queue.cc:260] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.541455 17233 ts_tablet_manager.cc:1367] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.010s
I20240503 08:12:23.543745 17232 ts_tablet_manager.cc:1398] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:23.544049 17232 tablet_bootstrap.cc:492] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8: Bootstrap starting.
I20240503 08:12:23.544031 17233 raft_consensus.cc:348] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.544368 17233 raft_consensus.cc:374] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.544490 17233 raft_consensus.cc:729] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.544718 17233 consensus_queue.cc:260] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.545295 17231 ts_tablet_manager.cc:1398] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:12:23.545567 17231 tablet_bootstrap.cc:492] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7: Bootstrap starting.
I20240503 08:12:23.545856 17232 tablet_bootstrap.cc:654] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.547220 17231 tablet_bootstrap.cc:654] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.548998 17233 ts_tablet_manager.cc:1398] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20240503 08:12:23.549310 17233 tablet_bootstrap.cc:492] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06: Bootstrap starting.
I20240503 08:12:23.550079 17232 tablet_bootstrap.cc:492] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8: No bootstrap required, opened a new log
I20240503 08:12:23.550256 17232 ts_tablet_manager.cc:1367] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20240503 08:12:23.551059 17232 raft_consensus.cc:348] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.551285 17232 raft_consensus.cc:374] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.551383 17232 raft_consensus.cc:729] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.551586 17233 tablet_bootstrap.cc:654] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.552040 17231 tablet_bootstrap.cc:492] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7: No bootstrap required, opened a new log
I20240503 08:12:23.552188 17231 ts_tablet_manager.cc:1367] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20240503 08:12:23.552470 17232 consensus_queue.cc:260] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.552872 17232 ts_tablet_manager.cc:1398] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20240503 08:12:23.553053 17231 raft_consensus.cc:348] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.553287 17231 raft_consensus.cc:374] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.553385 17231 raft_consensus.cc:729] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.553687 17232 tablet_bootstrap.cc:492] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8: Bootstrap starting.
I20240503 08:12:23.553599 17231 consensus_queue.cc:260] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.554078 17233 tablet_bootstrap.cc:492] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06: No bootstrap required, opened a new log
I20240503 08:12:23.554085 17231 ts_tablet_manager.cc:1398] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:12:23.554811 17233 ts_tablet_manager.cc:1367] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20240503 08:12:23.555320 17232 tablet_bootstrap.cc:654] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.555671 17233 raft_consensus.cc:348] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.555912 17233 raft_consensus.cc:374] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.555999 17233 raft_consensus.cc:729] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.556183 17231 tablet_bootstrap.cc:492] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7: Bootstrap starting.
I20240503 08:12:23.557808 17231 tablet_bootstrap.cc:654] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.558120 17232 tablet_bootstrap.cc:492] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8: No bootstrap required, opened a new log
I20240503 08:12:23.558272 17232 ts_tablet_manager.cc:1367] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240503 08:12:23.559119 17233 consensus_queue.cc:260] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.559717 17232 raft_consensus.cc:348] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.559912 17232 raft_consensus.cc:374] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.560009 17232 raft_consensus.cc:729] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.560312 17231 tablet_bootstrap.cc:492] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7: No bootstrap required, opened a new log
I20240503 08:12:23.560278 17233 ts_tablet_manager.cc:1398] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240503 08:12:23.560274 17232 consensus_queue.cc:260] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.560480 17231 ts_tablet_manager.cc:1367] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20240503 08:12:23.560678 17233 tablet_bootstrap.cc:492] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06: Bootstrap starting.
I20240503 08:12:23.560891 17232 ts_tablet_manager.cc:1398] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 08:12:23.561182 17232 tablet_bootstrap.cc:492] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8: Bootstrap starting.
I20240503 08:12:23.561225 17231 raft_consensus.cc:348] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.561401 17231 raft_consensus.cc:374] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.561497 17231 raft_consensus.cc:729] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.561760 17231 consensus_queue.cc:260] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.562345 17233 tablet_bootstrap.cc:654] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.562875 17232 tablet_bootstrap.cc:654] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.563805 17231 ts_tablet_manager.cc:1398] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240503 08:12:23.564131 17231 tablet_bootstrap.cc:492] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7: Bootstrap starting.
I20240503 08:12:23.567867 17233 tablet_bootstrap.cc:492] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06: No bootstrap required, opened a new log
I20240503 08:12:23.567880 17232 tablet_bootstrap.cc:492] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8: No bootstrap required, opened a new log
I20240503 08:12:23.568028 17233 ts_tablet_manager.cc:1367] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20240503 08:12:23.568094 17232 ts_tablet_manager.cc:1367] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20240503 08:12:23.568531 17231 tablet_bootstrap.cc:654] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.568684 17233 raft_consensus.cc:348] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.568863 17233 raft_consensus.cc:374] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.568972 17233 raft_consensus.cc:729] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.568888 17232 raft_consensus.cc:348] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.569120 17232 raft_consensus.cc:374] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.569218 17232 raft_consensus.cc:729] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.569288 17233 consensus_queue.cc:260] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.569454 17232 consensus_queue.cc:260] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.569902 17233 ts_tablet_manager.cc:1398] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:12:23.570011 17232 ts_tablet_manager.cc:1398] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:12:23.570238 17233 tablet_bootstrap.cc:492] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06: Bootstrap starting.
I20240503 08:12:23.571913 17233 tablet_bootstrap.cc:654] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:23.576507 17231 tablet_bootstrap.cc:492] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7: No bootstrap required, opened a new log
I20240503 08:12:23.576694 17231 ts_tablet_manager.cc:1367] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.009s
I20240503 08:12:23.577525 17231 raft_consensus.cc:348] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.577776 17231 raft_consensus.cc:374] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.577854 17231 raft_consensus.cc:729] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.578099 17231 consensus_queue.cc:260] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.578647 17231 ts_tablet_manager.cc:1398] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:12:23.580585 17233 tablet_bootstrap.cc:492] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06: No bootstrap required, opened a new log
I20240503 08:12:23.580751 17233 ts_tablet_manager.cc:1367] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20240503 08:12:23.581560 17233 raft_consensus.cc:348] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.581769 17233 raft_consensus.cc:374] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:23.581848 17233 raft_consensus.cc:729] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Initialized, Role: FOLLOWER
I20240503 08:12:23.582116 17233 consensus_queue.cc:260] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.582588 17233 ts_tablet_manager.cc:1398] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:12:23.582736 17238 raft_consensus.cc:482] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:23.582890 17238 raft_consensus.cc:504] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.583714 17238 leader_election.cc:288] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:23.586627 17237 raft_consensus.cc:482] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:23.586792 17237 raft_consensus.cc:504] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.588168 17237 leader_election.cc:288] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.592983 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7" is_pre_election: true
I20240503 08:12:23.593370 17042 raft_consensus.cc:2454] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 0.
I20240503 08:12:23.593372 17117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06" is_pre_election: true
I20240503 08:12:23.593690 17117 raft_consensus.cc:2454] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 0.
I20240503 08:12:23.594126 17157 leader_election.cc:302] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.594362 17238 raft_consensus.cc:2781] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:23.594471 17238 raft_consensus.cc:482] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:23.594559 17238 raft_consensus.cc:3037] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.596762 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129772b7c12040808cb9a9fbf09c95c8" is_pre_election: true
I20240503 08:12:23.597131 17191 raft_consensus.cc:2454] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 0.
I20240503 08:12:23.597095 17238 raft_consensus.cc:504] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.597702 17005 leader_election.cc:302] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.597751 17238 leader_election.cc:288] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:23.597990 17237 raft_consensus.cc:2781] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:23.598102 17237 raft_consensus.cc:482] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:23.598209 17237 raft_consensus.cc:3037] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.600582 17237 raft_consensus.cc:504] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.601089 17237 leader_election.cc:288] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 election: Requested vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.601349 17117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:23.601500 17117 raft_consensus.cc:3037] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.603524 17117 raft_consensus.cc:2454] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 1.
I20240503 08:12:23.604416 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:23.604620 17042 raft_consensus.cc:3037] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.604658 17157 leader_election.cc:302] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:23.604984 17238 raft_consensus.cc:2781] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:23.605423 17238 raft_consensus.cc:686] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Becoming Leader. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:23.605768 17238 consensus_queue.cc:237] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.607165 17042 raft_consensus.cc:2454] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 1.
I20240503 08:12:23.604458 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:23.607476 17191 raft_consensus.cc:3037] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.608994 16938 catalog_manager.cc:5484] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "129772b7c12040808cb9a9fbf09c95c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:23.609830 17191 raft_consensus.cc:2454] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 1.
I20240503 08:12:23.610209 17005 leader_election.cc:302] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.610505 17237 raft_consensus.cc:2781] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:23.610935 17237 raft_consensus.cc:686] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Becoming Leader. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:23.611243 17237 consensus_queue.cc:237] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.613837 17117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06" is_pre_election: true
I20240503 08:12:23.614089 17117 raft_consensus.cc:2454] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 0.
I20240503 08:12:23.613991 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:23.614302 17116 raft_consensus.cc:3037] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.614187 16938 catalog_manager.cc:5484] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:23.616618 17116 raft_consensus.cc:2454] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 1.
I20240503 08:12:23.621198 17237 raft_consensus.cc:482] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:23.621351 17237 raft_consensus.cc:504] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.621860 17237 leader_election.cc:288] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.622253 17237 raft_consensus.cc:482] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:23.622344 17272 raft_consensus.cc:482] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:23.622368 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0ddeaed6b6b46fa8fb5de4cc6b1593d" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06" is_pre_election: true
I20240503 08:12:23.622423 17237 raft_consensus.cc:504] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.622445 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0ddeaed6b6b46fa8fb5de4cc6b1593d" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129772b7c12040808cb9a9fbf09c95c8" is_pre_election: true
I20240503 08:12:23.622604 17116 raft_consensus.cc:2454] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 0.
I20240503 08:12:23.622794 17191 raft_consensus.cc:2454] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 0.
I20240503 08:12:23.622521 17272 raft_consensus.cc:504] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } } peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } }
I20240503 08:12:23.623175 17005 leader_election.cc:302] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.623205 17238 raft_consensus.cc:482] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:23.623301 17237 leader_election.cc:288] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.623482 17237 raft_consensus.cc:2781] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:23.623396 17238 raft_consensus.cc:504] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.623595 17237 raft_consensus.cc:482] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:23.623692 17272 leader_election.cc:288] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.623698 17237 raft_consensus.cc:3037] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.623975 17238 leader_election.cc:288] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:23.624604 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98deac96b39c4913a453310aef642721" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06" is_pre_election: true
I20240503 08:12:23.624790 17116 raft_consensus.cc:2454] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 0.
I20240503 08:12:23.625137 17157 leader_election.cc:302] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:23.625381 17238 raft_consensus.cc:2781] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:23.625476 17238 raft_consensus.cc:482] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:23.625597 17238 raft_consensus.cc:3037] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.627036 17237 raft_consensus.cc:504] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.627714 17237 leader_election.cc:288] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 election: Requested vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.627671 17238 raft_consensus.cc:504] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.628242 17238 leader_election.cc:288] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:23.628633 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98deac96b39c4913a453310aef642721" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:23.628741 17117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "810966f2a982466ca03159edc4b4b35d" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06" is_pre_election: true
I20240503 08:12:23.628844 17116 raft_consensus.cc:3037] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.628918 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "810966f2a982466ca03159edc4b4b35d" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129772b7c12040808cb9a9fbf09c95c8" is_pre_election: true
I20240503 08:12:23.628975 17117 raft_consensus.cc:2454] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 0.
I20240503 08:12:23.628930 17115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb4aa868b8642378606d84949c3559c" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06" is_pre_election: true
I20240503 08:12:23.629142 17191 raft_consensus.cc:2454] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 0.
I20240503 08:12:23.629166 17115 raft_consensus.cc:2454] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 0.
I20240503 08:12:23.629678 17115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0ddeaed6b6b46fa8fb5de4cc6b1593d" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:23.629848 17115 raft_consensus.cc:3037] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.630110 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0ddeaed6b6b46fa8fb5de4cc6b1593d" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:23.630352 17190 raft_consensus.cc:3037] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.629840 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb4aa868b8642378606d84949c3559c" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129772b7c12040808cb9a9fbf09c95c8" is_pre_election: true
I20240503 08:12:23.630713 17191 raft_consensus.cc:2454] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 0.
I20240503 08:12:23.631191 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98deac96b39c4913a453310aef642721" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7" is_pre_election: true
I20240503 08:12:23.631394 17042 raft_consensus.cc:2454] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 0.
I20240503 08:12:23.631795 17116 raft_consensus.cc:2454] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 1.
I20240503 08:12:23.631844 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98deac96b39c4913a453310aef642721" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:23.632521 17042 raft_consensus.cc:3037] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.633083 17115 raft_consensus.cc:2454] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 1.
I20240503 08:12:23.633407 17157 leader_election.cc:302] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:23.633492 17008 leader_election.cc:302] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.633706 17238 raft_consensus.cc:2781] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:23.633857 17008 leader_election.cc:302] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.633903 17190 raft_consensus.cc:2454] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 1.
I20240503 08:12:23.633868 17238 raft_consensus.cc:686] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Becoming Leader. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:23.634168 17237 raft_consensus.cc:2781] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:23.634263 17237 raft_consensus.cc:482] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:23.634450 17237 raft_consensus.cc:3037] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.634268 17238 consensus_queue.cc:237] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.635270 17005 leader_election.cc:302] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.635440 17042 raft_consensus.cc:2454] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 1.
I20240503 08:12:23.635725 17274 raft_consensus.cc:2781] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:23.635778 17272 raft_consensus.cc:2781] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:23.635844 17274 raft_consensus.cc:482] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:23.635975 17274 raft_consensus.cc:3037] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.637125 17237 raft_consensus.cc:504] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.637836 17237 leader_election.cc:288] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 election: Requested vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.638279 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "810966f2a982466ca03159edc4b4b35d" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:23.638401 17115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "810966f2a982466ca03159edc4b4b35d" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:23.638643 17115 raft_consensus.cc:3037] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.640841 17115 raft_consensus.cc:2454] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 1.
I20240503 08:12:23.640652 16938 catalog_manager.cc:5484] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "129772b7c12040808cb9a9fbf09c95c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:23.638473 17190 raft_consensus.cc:3037] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.643085 17190 raft_consensus.cc:2454] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 1.
I20240503 08:12:23.643479 17008 leader_election.cc:302] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.643661 17272 raft_consensus.cc:686] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Becoming Leader. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:23.643910 17276 raft_consensus.cc:2781] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:23.643986 17272 consensus_queue.cc:237] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.644137 17276 raft_consensus.cc:686] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Becoming Leader. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:23.645148 17276 consensus_queue.cc:237] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.647184 17274 raft_consensus.cc:504] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } } peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } }
I20240503 08:12:23.647511 16938 catalog_manager.cc:5484] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:23.647776 17274 leader_election.cc:288] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 election: Requested vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.648142 17115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb4aa868b8642378606d84949c3559c" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:23.648298 17115 raft_consensus.cc:3037] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.650523 17115 raft_consensus.cc:2454] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 1.
I20240503 08:12:23.650837 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fb4aa868b8642378606d84949c3559c" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:23.650907 17008 leader_election.cc:302] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.651031 17190 raft_consensus.cc:3037] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.651212 17272 raft_consensus.cc:2781] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:23.651423 17272 raft_consensus.cc:686] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Becoming Leader. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:23.651746 17272 consensus_queue.cc:237] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } } peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } }
I20240503 08:12:23.652226 16938 catalog_manager.cc:5484] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:23.653802 17190 raft_consensus.cc:2454] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 1.
I20240503 08:12:23.656345 16938 catalog_manager.cc:5484] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:23.672691 17238 raft_consensus.cc:482] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:23.672894 17238 raft_consensus.cc:504] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.673540 17238 leader_election.cc:288] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:23.674078 17115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3aed7f93894ea1a6edafb5fc4b6632" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06" is_pre_election: true
I20240503 08:12:23.674108 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3aed7f93894ea1a6edafb5fc4b6632" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7" is_pre_election: true
I20240503 08:12:23.674296 17115 raft_consensus.cc:2454] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 0.
I20240503 08:12:23.674304 17042 raft_consensus.cc:2454] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 0.
I20240503 08:12:23.674649 17157 leader_election.cc:302] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:23.674885 17238 raft_consensus.cc:2781] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:23.675007 17238 raft_consensus.cc:482] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:23.675088 17238 raft_consensus.cc:3037] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.676983 17238 raft_consensus.cc:504] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.677523 17238 leader_election.cc:288] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:23.677991 17115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3aed7f93894ea1a6edafb5fc4b6632" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:23.677999 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3aed7f93894ea1a6edafb5fc4b6632" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:23.678179 17115 raft_consensus.cc:3037] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.678189 17042 raft_consensus.cc:3037] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.680130 17272 raft_consensus.cc:482] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:23.680347 17272 raft_consensus.cc:504] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.680958 17042 raft_consensus.cc:2454] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 1.
I20240503 08:12:23.681042 17115 raft_consensus.cc:2454] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 1.
I20240503 08:12:23.681421 17157 leader_election.cc:302] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:23.681710 17272 leader_election.cc:288] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.681648 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4f2725a98274d7e85fdfd2c1bc8df10" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06" is_pre_election: true
I20240503 08:12:23.681716 17238 raft_consensus.cc:2781] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:23.681878 17116 raft_consensus.cc:2454] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 0.
I20240503 08:12:23.682003 17238 raft_consensus.cc:686] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Becoming Leader. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:23.681641 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4f2725a98274d7e85fdfd2c1bc8df10" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129772b7c12040808cb9a9fbf09c95c8" is_pre_election: true
I20240503 08:12:23.682209 17008 leader_election.cc:302] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.682307 17190 raft_consensus.cc:2454] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 0.
I20240503 08:12:23.682332 17238 consensus_queue.cc:237] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.682474 17272 raft_consensus.cc:2781] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:23.682565 17272 raft_consensus.cc:482] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:23.682663 17272 raft_consensus.cc:3037] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.684849 17272 raft_consensus.cc:504] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.684932 16938 catalog_manager.cc:5484] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "129772b7c12040808cb9a9fbf09c95c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:23.685400 17272 leader_election.cc:288] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 election: Requested vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.685693 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4f2725a98274d7e85fdfd2c1bc8df10" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:23.685765 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4f2725a98274d7e85fdfd2c1bc8df10" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:23.685878 17116 raft_consensus.cc:3037] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.685933 17190 raft_consensus.cc:3037] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.688587 17116 raft_consensus.cc:2454] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 1.
I20240503 08:12:23.688972 17190 raft_consensus.cc:2454] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 1.
I20240503 08:12:23.689240 17008 leader_election.cc:302] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.689471 17272 raft_consensus.cc:2781] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:23.689620 17272 raft_consensus.cc:686] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Becoming Leader. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:23.689828 17272 consensus_queue.cc:237] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.692605 16938 catalog_manager.cc:5484] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:23.717335 17238 raft_consensus.cc:482] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:23.717540 17238 raft_consensus.cc:504] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.718158 17238 leader_election.cc:288] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:23.718688 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da6d226e790440eb97f22ade721af57" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06" is_pre_election: true
I20240503 08:12:23.718695 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da6d226e790440eb97f22ade721af57" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7" is_pre_election: true
I20240503 08:12:23.718909 17116 raft_consensus.cc:2454] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 0.
I20240503 08:12:23.718982 17042 raft_consensus.cc:2454] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 0.
I20240503 08:12:23.719305 17157 leader_election.cc:302] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:23.719588 17238 raft_consensus.cc:2781] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:23.719695 17238 raft_consensus.cc:482] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:23.719767 17238 raft_consensus.cc:3037] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.721601 17238 raft_consensus.cc:504] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.722097 17238 leader_election.cc:288] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:23.722574 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da6d226e790440eb97f22ade721af57" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:23.722575 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da6d226e790440eb97f22ade721af57" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:23.722836 17116 raft_consensus.cc:3037] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.722859 17042 raft_consensus.cc:3037] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.725769 17116 raft_consensus.cc:2454] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 1.
I20240503 08:12:23.725769 17042 raft_consensus.cc:2454] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 1.
I20240503 08:12:23.726178 17157 leader_election.cc:302] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.726428 17238 raft_consensus.cc:2781] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:23.726588 17238 raft_consensus.cc:686] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Becoming Leader. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:23.726856 17238 consensus_queue.cc:237] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.729286 16938 catalog_manager.cc:5484] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "129772b7c12040808cb9a9fbf09c95c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:23.801537 17240 raft_consensus.cc:482] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:23.801730 17240 raft_consensus.cc:504] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.802493 17240 leader_election.cc:288] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.809062 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28fa7c15a1924e0d87ec1a5dbc01a60c" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129772b7c12040808cb9a9fbf09c95c8" is_pre_election: true
I20240503 08:12:23.809080 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28fa7c15a1924e0d87ec1a5dbc01a60c" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7" is_pre_election: true
I20240503 08:12:23.809309 17190 raft_consensus.cc:2454] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 0.
I20240503 08:12:23.809372 17042 raft_consensus.cc:2454] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 0.
I20240503 08:12:23.809711 17080 leader_election.cc:302] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:23.809968 17240 raft_consensus.cc:2781] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:23.810066 17240 raft_consensus.cc:482] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:23.810153 17240 raft_consensus.cc:3037] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.812119 17240 raft_consensus.cc:504] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.812752 17240 leader_election.cc:288] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 1 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:23.813266 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28fa7c15a1924e0d87ec1a5dbc01a60c" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:23.813290 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28fa7c15a1924e0d87ec1a5dbc01a60c" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:23.813493 17190 raft_consensus.cc:3037] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.813498 17042 raft_consensus.cc:3037] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:23.816429 17190 raft_consensus.cc:2454] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 1.
I20240503 08:12:23.816448 17042 raft_consensus.cc:2454] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 1.
I20240503 08:12:23.816893 17083 leader_election.cc:302] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:23.817215 17240 raft_consensus.cc:2781] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:23.817577 17240 raft_consensus.cc:686] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 1 LEADER]: Becoming Leader. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Running, Role: LEADER
I20240503 08:12:23.817859 17240 consensus_queue.cc:237] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:23.820676 16938 catalog_manager.cc:5484] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66). New cstate: current_term: 1 leader_uuid: "9ad100ff3b5049f3966c923497e18f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:23.917574 17190 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1"
dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
mode: GRACEFUL
new_leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
from {username='slave'} at 127.0.0.1:48996
I20240503 08:12:23.917791 17190 raft_consensus.cc:595] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Received request to transfer leadership to TS adf8f413c64f4c2389e9389dd2b638c7
I20240503 08:12:23.919840 17190 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9da6d226e790440eb97f22ade721af57"
dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
mode: GRACEFUL
new_leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
from {username='slave'} at 127.0.0.1:48996
I20240503 08:12:23.920017 17190 raft_consensus.cc:595] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Received request to transfer leadership to TS adf8f413c64f4c2389e9389dd2b638c7
I20240503 08:12:23.921836 17190 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8d3aed7f93894ea1a6edafb5fc4b6632"
dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
mode: GRACEFUL
new_leader_uuid: "9ad100ff3b5049f3966c923497e18f06"
from {username='slave'} at 127.0.0.1:48996
I20240503 08:12:23.922004 17190 raft_consensus.cc:595] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Received request to transfer leadership to TS 9ad100ff3b5049f3966c923497e18f06
I20240503 08:12:23.928781 17042 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
mode: GRACEFUL
new_leader_uuid: "9ad100ff3b5049f3966c923497e18f06"
from {username='slave'} at 127.0.0.1:41662
I20240503 08:12:23.928994 17042 raft_consensus.cc:595] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Received request to transfer leadership to TS 9ad100ff3b5049f3966c923497e18f06
I20240503 08:12:23.930805 17190 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "98deac96b39c4913a453310aef642721"
dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
mode: GRACEFUL
new_leader_uuid: "9ad100ff3b5049f3966c923497e18f06"
from {username='slave'} at 127.0.0.1:48996
I20240503 08:12:23.930985 17190 raft_consensus.cc:595] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Received request to transfer leadership to TS 9ad100ff3b5049f3966c923497e18f06
I20240503 08:12:23.932746 17042 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d4f2725a98274d7e85fdfd2c1bc8df10"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
mode: GRACEFUL
new_leader_uuid: "129772b7c12040808cb9a9fbf09c95c8"
from {username='slave'} at 127.0.0.1:41662
I20240503 08:12:23.932907 17042 raft_consensus.cc:595] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Received request to transfer leadership to TS 129772b7c12040808cb9a9fbf09c95c8
I20240503 08:12:24.015638 17272 consensus_queue.cc:1035] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.016319 17272 consensus_queue.cc:1035] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.018640 17274 raft_consensus.cc:979] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7: : Instructing follower 9ad100ff3b5049f3966c923497e18f06 to start an election
I20240503 08:12:24.018837 17274 raft_consensus.cc:1067] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Signalling peer 9ad100ff3b5049f3966c923497e18f06 to start an election
I20240503 08:12:24.019487 17115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5"
dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
from {username='slave'} at 127.0.0.1:36816
I20240503 08:12:24.019671 17115 raft_consensus.cc:482] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:24.019798 17115 raft_consensus.cc:3037] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.022147 17115 raft_consensus.cc:504] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.023223 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:24.023463 17042 raft_consensus.cc:3032] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:12:24.023592 17042 raft_consensus.cc:729] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:24.023823 17116 raft_consensus.cc:1226] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Rejecting Update request from peer adf8f413c64f4c2389e9389dd2b638c7 for earlier term 1. Current term is 2. Ops: []
I20240503 08:12:24.023880 17042 consensus_queue.cc:260] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.024215 17042 raft_consensus.cc:3037] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.024631 17115 leader_election.cc:288] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 2 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:24.026883 17042 raft_consensus.cc:2454] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 2.
I20240503 08:12:24.027256 17083 leader_election.cc:302] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:24.023217 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:24.027616 17240 raft_consensus.cc:2781] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:12:24.027786 17240 raft_consensus.cc:686] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Becoming Leader. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Running, Role: LEADER
I20240503 08:12:24.027835 17190 raft_consensus.cc:3037] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.028076 17240 consensus_queue.cc:237] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.030192 17190 raft_consensus.cc:2454] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 2.
I20240503 08:12:24.030956 16937 catalog_manager.cc:5484] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 reported cstate change: term changed from 1 to 2, leader changed from adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65) to 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66). New cstate: current_term: 2 leader_uuid: "9ad100ff3b5049f3966c923497e18f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:24.043037 17238 consensus_queue.cc:1035] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.047156 17238 consensus_queue.cc:1035] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.049770 17293 raft_consensus.cc:979] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8: : Instructing follower adf8f413c64f4c2389e9389dd2b638c7 to start an election
I20240503 08:12:24.049960 17238 raft_consensus.cc:1067] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Signalling peer adf8f413c64f4c2389e9389dd2b638c7 to start an election
I20240503 08:12:24.050524 17042 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
from {username='slave'} at 127.0.0.1:41646
I20240503 08:12:24.050719 17042 raft_consensus.cc:482] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:24.050815 17042 raft_consensus.cc:3037] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.052739 17042 raft_consensus.cc:504] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.053268 17042 leader_election.cc:288] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 2 election: Requested vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:24.053745 17115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:24.053963 17115 raft_consensus.cc:3037] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.055963 17115 raft_consensus.cc:2454] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 2.
I20240503 08:12:24.056350 17008 leader_election.cc:302] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:24.056464 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:24.056604 17274 raft_consensus.cc:2781] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:12:24.056644 17190 raft_consensus.cc:3032] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:12:24.056749 17190 raft_consensus.cc:729] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:24.056773 17274 raft_consensus.cc:686] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 LEADER]: Becoming Leader. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:24.057020 17190 consensus_queue.cc:260] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.057042 17274 consensus_queue.cc:237] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.057346 17190 raft_consensus.cc:3037] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.059376 16937 catalog_manager.cc:5484] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 reported cstate change: term changed from 1 to 2, leader changed from 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67) to adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65). New cstate: current_term: 2 leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:24.059616 17190 raft_consensus.cc:2454] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 2.
I20240503 08:12:24.077489 17238 consensus_queue.cc:1035] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.079806 17274 consensus_queue.cc:1035] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.080238 17270 raft_consensus.cc:979] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8: : Instructing follower 9ad100ff3b5049f3966c923497e18f06 to start an election
I20240503 08:12:24.080379 17293 raft_consensus.cc:1067] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Signalling peer 9ad100ff3b5049f3966c923497e18f06 to start an election
I20240503 08:12:24.082505 17238 consensus_queue.cc:1035] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.085745 17117 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "98deac96b39c4913a453310aef642721"
dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
from {username='slave'} at 127.0.0.1:36804
I20240503 08:12:24.086419 17117 raft_consensus.cc:482] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:24.086566 17117 raft_consensus.cc:3037] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.090611 17274 consensus_queue.cc:1035] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.090695 17117 raft_consensus.cc:504] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.091365 17117 leader_election.cc:288] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 2 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:24.092125 17041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98deac96b39c4913a453310aef642721" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:24.092350 17041 raft_consensus.cc:3037] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.092782 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98deac96b39c4913a453310aef642721" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:24.092995 17191 raft_consensus.cc:3032] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:12:24.093080 17191 raft_consensus.cc:729] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:24.093375 17191 consensus_queue.cc:260] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.093878 17191 raft_consensus.cc:3037] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.095335 17041 raft_consensus.cc:2454] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 2.
I20240503 08:12:24.096256 17083 leader_election.cc:302] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:24.096510 17240 raft_consensus.cc:2781] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:12:24.096674 17240 raft_consensus.cc:686] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Becoming Leader. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Running, Role: LEADER
I20240503 08:12:24.097012 17240 consensus_queue.cc:237] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.096668 17191 raft_consensus.cc:2454] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 2.
I20240503 08:12:24.099069 16937 catalog_manager.cc:5484] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 reported cstate change: term changed from 1 to 2, leader changed from 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67) to 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66). New cstate: current_term: 2 leader_uuid: "9ad100ff3b5049f3966c923497e18f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:24.109349 17274 consensus_queue.cc:1035] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.113376 17272 consensus_queue.cc:1035] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.140908 17272 consensus_queue.cc:1035] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.144829 17276 consensus_queue.cc:1035] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.171269 17298 consensus_queue.cc:1035] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.173434 17298 consensus_queue.cc:1035] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.174232 17238 raft_consensus.cc:979] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8: : Instructing follower 9ad100ff3b5049f3966c923497e18f06 to start an election
I20240503 08:12:24.174402 17238 raft_consensus.cc:1067] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Signalling peer 9ad100ff3b5049f3966c923497e18f06 to start an election
I20240503 08:12:24.175789 17116 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8d3aed7f93894ea1a6edafb5fc4b6632"
dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
from {username='slave'} at 127.0.0.1:36804
I20240503 08:12:24.176155 17116 raft_consensus.cc:482] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:24.176276 17116 raft_consensus.cc:3037] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.176412 17238 consensus_queue.cc:1035] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.178216 17238 raft_consensus.cc:979] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8: : Instructing follower adf8f413c64f4c2389e9389dd2b638c7 to start an election
I20240503 08:12:24.178354 17238 raft_consensus.cc:1067] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Signalling peer adf8f413c64f4c2389e9389dd2b638c7 to start an election
I20240503 08:12:24.179873 17040 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9da6d226e790440eb97f22ade721af57"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
from {username='slave'} at 127.0.0.1:41646
I20240503 08:12:24.180155 17040 raft_consensus.cc:482] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:24.180342 17040 raft_consensus.cc:3037] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.180315 17298 consensus_queue.cc:1035] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.179282 17116 raft_consensus.cc:504] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.180799 17117 raft_consensus.cc:1226] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Rejecting Update request from peer 129772b7c12040808cb9a9fbf09c95c8 for earlier term 1. Current term is 2. Ops: []
I20240503 08:12:24.181545 17270 consensus_queue.cc:1046] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.181892 17270 raft_consensus.cc:3032] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:12:24.181990 17270 raft_consensus.cc:729] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:24.182161 17116 leader_election.cc:288] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 2 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:24.182344 17270 consensus_queue.cc:260] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.182698 17270 raft_consensus.cc:3037] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.183198 17040 raft_consensus.cc:504] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.183746 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3aed7f93894ea1a6edafb5fc4b6632" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:24.184304 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3aed7f93894ea1a6edafb5fc4b6632" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:24.184484 17042 raft_consensus.cc:3037] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.185657 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da6d226e790440eb97f22ade721af57" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:24.185830 17190 raft_consensus.cc:3032] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:12:24.186445 17190 raft_consensus.cc:729] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:24.186645 17115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da6d226e790440eb97f22ade721af57" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:24.186923 17115 raft_consensus.cc:3037] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.186715 17190 consensus_queue.cc:260] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.187297 17190 raft_consensus.cc:3037] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.188091 17042 raft_consensus.cc:2454] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 2.
I20240503 08:12:24.189162 17083 leader_election.cc:302] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:24.189380 17191 raft_consensus.cc:2454] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 2.
I20240503 08:12:24.189441 17240 raft_consensus.cc:2781] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:12:24.189589 17240 raft_consensus.cc:686] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Becoming Leader. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Running, Role: LEADER
I20240503 08:12:24.189932 17190 raft_consensus.cc:2454] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 2.
I20240503 08:12:24.189880 17240 consensus_queue.cc:237] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.190151 17040 leader_election.cc:288] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 2 election: Requested vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:24.190840 17005 leader_election.cc:302] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:24.191048 17274 consensus_queue.cc:1035] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.191128 17276 raft_consensus.cc:2781] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:12:24.191259 17276 raft_consensus.cc:686] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 LEADER]: Becoming Leader. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:24.191527 17276 consensus_queue.cc:237] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.193593 17115 raft_consensus.cc:2454] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 2.
I20240503 08:12:24.194684 16937 catalog_manager.cc:5484] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 reported cstate change: term changed from 1 to 2, leader changed from 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67) to adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65). New cstate: current_term: 2 leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:24.195327 17276 consensus_queue.cc:1035] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.197909 17276 raft_consensus.cc:979] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7: : Instructing follower 129772b7c12040808cb9a9fbf09c95c8 to start an election
I20240503 08:12:24.198043 17276 raft_consensus.cc:1067] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Signalling peer 129772b7c12040808cb9a9fbf09c95c8 to start an election
I20240503 08:12:24.198575 17190 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d4f2725a98274d7e85fdfd2c1bc8df10"
dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
from {username='slave'} at 127.0.0.1:48978
I20240503 08:12:24.198825 17190 raft_consensus.cc:482] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:24.198976 17190 raft_consensus.cc:3037] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.198645 16939 catalog_manager.cc:5484] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 reported cstate change: term changed from 1 to 2, leader changed from 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67) to 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66). New cstate: current_term: 2 leader_uuid: "9ad100ff3b5049f3966c923497e18f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:24.202499 17190 raft_consensus.cc:504] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.203228 17190 leader_election.cc:288] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 2 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:24.203640 17115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4f2725a98274d7e85fdfd2c1bc8df10" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:24.203832 17115 raft_consensus.cc:3037] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.204624 17040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4f2725a98274d7e85fdfd2c1bc8df10" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:24.204870 17040 raft_consensus.cc:3032] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:12:24.204993 17040 raft_consensus.cc:729] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:24.205327 17040 consensus_queue.cc:260] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.205672 17040 raft_consensus.cc:3037] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:24.206398 17115 raft_consensus.cc:2454] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 2.
I20240503 08:12:24.206775 17157 leader_election.cc:302] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:24.207072 17270 raft_consensus.cc:2781] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:12:24.207227 17270 raft_consensus.cc:686] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 LEADER]: Becoming Leader. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:24.207510 17270 consensus_queue.cc:237] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:24.208328 17040 raft_consensus.cc:2454] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 2.
I20240503 08:12:24.209659 16937 catalog_manager.cc:5484] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 reported cstate change: term changed from 1 to 2, leader changed from adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65) to 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67). New cstate: current_term: 2 leader_uuid: "129772b7c12040808cb9a9fbf09c95c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:24.266258 17240 consensus_queue.cc:1035] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.270922 17240 consensus_queue.cc:1035] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:24.455473 17190 raft_consensus.cc:1261] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Refusing update from remote peer 9ad100ff3b5049f3966c923497e18f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:24.456058 17240 consensus_queue.cc:1035] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:24.459151 17040 raft_consensus.cc:1261] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Refusing update from remote peer 9ad100ff3b5049f3966c923497e18f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:24.459720 17285 consensus_queue.cc:1035] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:24.493424 17190 raft_consensus.cc:1261] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Refusing update from remote peer 9ad100ff3b5049f3966c923497e18f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:24.493985 17285 consensus_queue.cc:1035] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:24.497262 17040 raft_consensus.cc:1261] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Refusing update from remote peer 9ad100ff3b5049f3966c923497e18f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:24.497944 17312 consensus_queue.cc:1035] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:24.541806 17190 raft_consensus.cc:1261] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Refusing update from remote peer adf8f413c64f4c2389e9389dd2b638c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:24.542368 17276 consensus_queue.cc:1035] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:24.545568 17115 raft_consensus.cc:1261] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Refusing update from remote peer adf8f413c64f4c2389e9389dd2b638c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:24.546263 17276 consensus_queue.cc:1035] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:24.575326 17040 raft_consensus.cc:1261] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Refusing update from remote peer 9ad100ff3b5049f3966c923497e18f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:24.575865 17312 consensus_queue.cc:1035] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:24.579114 17190 raft_consensus.cc:1261] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Refusing update from remote peer 9ad100ff3b5049f3966c923497e18f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:24.579685 17285 consensus_queue.cc:1035] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:24.589450 17115 raft_consensus.cc:1261] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Refusing update from remote peer 129772b7c12040808cb9a9fbf09c95c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:24.589955 17270 consensus_queue.cc:1035] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:24.593236 17040 raft_consensus.cc:1261] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Refusing update from remote peer 129772b7c12040808cb9a9fbf09c95c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:24.593698 17293 consensus_queue.cc:1035] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:24.720443 17190 raft_consensus.cc:1261] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Refusing update from remote peer adf8f413c64f4c2389e9389dd2b638c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:24.720993 17276 consensus_queue.cc:1035] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:24.723902 17115 raft_consensus.cc:1261] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Refusing update from remote peer adf8f413c64f4c2389e9389dd2b638c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:24.724458 17276 consensus_queue.cc:1035] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:26.943663 16425 auto_leader_rebalancer-test.cc:331] The leader distribution is
I20240503 08:12:26.943938 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:26.951450 17115 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "28fa7c15a1924e0d87ec1a5dbc01a60c"
dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
mode: GRACEFUL
new_leader_uuid: "129772b7c12040808cb9a9fbf09c95c8"
from {username='slave'} at 127.0.0.1:54638
I20240503 08:12:26.951640 17115 raft_consensus.cc:595] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 1 LEADER]: Received request to transfer leadership to TS 129772b7c12040808cb9a9fbf09c95c8
I20240503 08:12:26.957012 17040 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
mode: GRACEFUL
new_leader_uuid: "129772b7c12040808cb9a9fbf09c95c8"
from {username='slave'} at 127.0.0.1:37744
I20240503 08:12:26.957211 17040 raft_consensus.cc:595] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 LEADER]: Received request to transfer leadership to TS 129772b7c12040808cb9a9fbf09c95c8
I20240503 08:12:26.957674 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240503 08:12:26.957864 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:27.338510 17240 raft_consensus.cc:979] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06: : Instructing follower 129772b7c12040808cb9a9fbf09c95c8 to start an election
I20240503 08:12:27.338690 17240 raft_consensus.cc:1067] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 1 LEADER]: Signalling peer 129772b7c12040808cb9a9fbf09c95c8 to start an election
I20240503 08:12:27.339323 17190 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "28fa7c15a1924e0d87ec1a5dbc01a60c"
dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
from {username='slave'} at 127.0.0.1:48992
I20240503 08:12:27.339532 17190 raft_consensus.cc:482] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:27.339629 17190 raft_consensus.cc:3037] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:27.342012 17190 raft_consensus.cc:504] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:27.342603 17190 leader_election.cc:288] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 2 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:27.343001 17040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28fa7c15a1924e0d87ec1a5dbc01a60c" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:27.343216 17040 raft_consensus.cc:3037] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:27.343220 17115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28fa7c15a1924e0d87ec1a5dbc01a60c" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:27.343499 17115 raft_consensus.cc:3032] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:12:27.343587 17115 raft_consensus.cc:729] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Running, Role: LEADER
I20240503 08:12:27.343803 17115 consensus_queue.cc:260] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:27.344062 17115 raft_consensus.cc:3037] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:27.345407 17040 raft_consensus.cc:2454] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 2.
I20240503 08:12:27.345834 17157 leader_election.cc:302] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:27.345853 17115 raft_consensus.cc:2454] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 2.
I20240503 08:12:27.346141 17315 raft_consensus.cc:2781] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:12:27.346549 17315 raft_consensus.cc:686] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 2 LEADER]: Becoming Leader. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:27.346817 17315 consensus_queue.cc:237] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:27.349169 16938 catalog_manager.cc:5484] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 reported cstate change: term changed from 1 to 2, leader changed from 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66) to 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67). New cstate: current_term: 2 leader_uuid: "129772b7c12040808cb9a9fbf09c95c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:27.433934 17272 raft_consensus.cc:979] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7: : Instructing follower 129772b7c12040808cb9a9fbf09c95c8 to start an election
I20240503 08:12:27.434092 17272 raft_consensus.cc:1067] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 LEADER]: Signalling peer 129772b7c12040808cb9a9fbf09c95c8 to start an election
I20240503 08:12:27.434698 17190 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1"
dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
from {username='slave'} at 127.0.0.1:48978
I20240503 08:12:27.434911 17190 raft_consensus.cc:482] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:27.435032 17190 raft_consensus.cc:3037] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:27.436966 17190 raft_consensus.cc:504] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:27.437525 17190 leader_election.cc:288] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 3 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:27.437924 17040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:27.438077 17040 raft_consensus.cc:3032] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:12:27.438032 17115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:27.438187 17040 raft_consensus.cc:729] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:27.438258 17115 raft_consensus.cc:3037] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:27.438448 17040 consensus_queue.cc:260] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:27.438766 17040 raft_consensus.cc:3037] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:27.440338 17115 raft_consensus.cc:2454] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 3.
I20240503 08:12:27.440672 17040 raft_consensus.cc:2454] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 3.
I20240503 08:12:27.440738 17157 leader_election.cc:302] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:27.441002 17315 raft_consensus.cc:2781] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:12:27.441174 17315 raft_consensus.cc:686] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 LEADER]: Becoming Leader. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:27.441416 17315 consensus_queue.cc:237] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:27.443725 16938 catalog_manager.cc:5484] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 reported cstate change: term changed from 2 to 3, leader changed from adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65) to 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67). New cstate: current_term: 3 leader_uuid: "129772b7c12040808cb9a9fbf09c95c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:27.760205 17115 raft_consensus.cc:1261] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Refusing update from remote peer 129772b7c12040808cb9a9fbf09c95c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:27.760746 17315 consensus_queue.cc:1035] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:27.765739 17040 raft_consensus.cc:1261] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Refusing update from remote peer 129772b7c12040808cb9a9fbf09c95c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:27.766397 17320 consensus_queue.cc:1035] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:27.958341 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:27.960016 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:27.960214 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:28.020198 17042 raft_consensus.cc:1261] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Refusing update from remote peer 129772b7c12040808cb9a9fbf09c95c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:28.020812 17331 consensus_queue.cc:1035] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:28.023854 17115 raft_consensus.cc:1261] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Refusing update from remote peer 129772b7c12040808cb9a9fbf09c95c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:28.024534 17320 consensus_queue.cc:1035] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:28.960625 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:28.962299 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:28.962486 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:29.962898 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:29.964702 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:29.964916 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:30.965313 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:30.967025 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:30.967195 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:31.967648 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:31.969280 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:31.969467 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:32.969859 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:32.971748 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:32.971956 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:33.972374 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:33.974048 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:33.974261 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:34.974647 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:34.976411 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:34.976581 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:35.976960 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:35.978788 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:35.978983 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:36.989213 16425 auto_leader_rebalancer-test.cc:350] The leader distribution is
I20240503 08:12:36.993654 17190 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1"
dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
mode: GRACEFUL
new_leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
from {username='slave'} at 127.0.0.1:48996
I20240503 08:12:36.993849 17190 raft_consensus.cc:595] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 LEADER]: Received request to transfer leadership to TS adf8f413c64f4c2389e9389dd2b638c7
I20240503 08:12:37.002378 17116 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8d3aed7f93894ea1a6edafb5fc4b6632"
dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
mode: GRACEFUL
new_leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
from {username='slave'} at 127.0.0.1:44136
I20240503 08:12:37.002617 17116 raft_consensus.cc:595] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Received request to transfer leadership to TS adf8f413c64f4c2389e9389dd2b638c7
I20240503 08:12:37.006114 17190 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "28fa7c15a1924e0d87ec1a5dbc01a60c"
dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
mode: GRACEFUL
new_leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
from {username='slave'} at 127.0.0.1:48996
I20240503 08:12:37.006399 17190 raft_consensus.cc:595] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 2 LEADER]: Received request to transfer leadership to TS adf8f413c64f4c2389e9389dd2b638c7
I20240503 08:12:37.008466 17116 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5"
dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
mode: GRACEFUL
new_leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
from {username='slave'} at 127.0.0.1:44136
I20240503 08:12:37.008651 17116 raft_consensus.cc:595] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Received request to transfer leadership to TS adf8f413c64f4c2389e9389dd2b638c7
I20240503 08:12:37.049013 17339 raft_consensus.cc:979] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8: : Instructing follower adf8f413c64f4c2389e9389dd2b638c7 to start an election
I20240503 08:12:37.049156 17339 raft_consensus.cc:1067] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 LEADER]: Signalling peer adf8f413c64f4c2389e9389dd2b638c7 to start an election
I20240503 08:12:37.049690 17042 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
from {username='slave'} at 127.0.0.1:41646
I20240503 08:12:37.049856 17042 raft_consensus.cc:482] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:37.049952 17042 raft_consensus.cc:3037] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:37.051823 17042 raft_consensus.cc:504] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:37.052363 17042 leader_election.cc:288] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 4 election: Requested vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:37.052728 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:37.052757 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f5aecc555e9496eba7f9bc5d67bdbd1" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:37.052892 17116 raft_consensus.cc:3037] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:37.052911 17190 raft_consensus.cc:3032] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 LEADER]: Stepping down as leader of term 3
I20240503 08:12:37.053006 17190 raft_consensus.cc:729] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:37.053273 17190 consensus_queue.cc:260] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:37.053582 17190 raft_consensus.cc:3037] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:37.054859 17116 raft_consensus.cc:2454] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 4.
I20240503 08:12:37.055255 17008 leader_election.cc:302] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:37.055562 17190 raft_consensus.cc:2454] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 4.
I20240503 08:12:37.055558 17340 raft_consensus.cc:2781] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:12:37.055984 17340 raft_consensus.cc:686] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 4 LEADER]: Becoming Leader. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:37.056337 17340 consensus_queue.cc:237] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:37.058562 16938 catalog_manager.cc:5484] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 reported cstate change: term changed from 3 to 4, leader changed from 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67) to adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65). New cstate: current_term: 4 leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:37.242542 17343 raft_consensus.cc:979] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8: : Instructing follower adf8f413c64f4c2389e9389dd2b638c7 to start an election
I20240503 08:12:37.242717 17343 raft_consensus.cc:1067] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 2 LEADER]: Signalling peer adf8f413c64f4c2389e9389dd2b638c7 to start an election
I20240503 08:12:37.243340 17042 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "28fa7c15a1924e0d87ec1a5dbc01a60c"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
from {username='slave'} at 127.0.0.1:41646
I20240503 08:12:37.243571 17042 raft_consensus.cc:482] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:37.243672 17042 raft_consensus.cc:3037] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:37.246047 17042 raft_consensus.cc:504] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:37.246623 17042 leader_election.cc:288] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 3 election: Requested vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:37.247046 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28fa7c15a1924e0d87ec1a5dbc01a60c" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:37.247160 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28fa7c15a1924e0d87ec1a5dbc01a60c" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:37.247300 17116 raft_consensus.cc:3037] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:37.247334 17190 raft_consensus.cc:3032] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:12:37.247438 17190 raft_consensus.cc:729] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:37.247704 17190 consensus_queue.cc:260] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:37.248067 17190 raft_consensus.cc:3037] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:37.250279 17116 raft_consensus.cc:2454] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 3.
I20240503 08:12:37.250574 17190 raft_consensus.cc:2454] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 3.
I20240503 08:12:37.250698 17008 leader_election.cc:302] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ad100ff3b5049f3966c923497e18f06, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:37.250967 17340 raft_consensus.cc:2781] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:12:37.251127 17340 raft_consensus.cc:686] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 3 LEADER]: Becoming Leader. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:37.251423 17340 consensus_queue.cc:237] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:37.253813 16938 catalog_manager.cc:5484] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 reported cstate change: term changed from 2 to 3, leader changed from 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67) to adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65). New cstate: current_term: 3 leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:37.289717 17351 raft_consensus.cc:979] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06: : Instructing follower adf8f413c64f4c2389e9389dd2b638c7 to start an election
I20240503 08:12:37.289883 17351 raft_consensus.cc:1067] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Signalling peer adf8f413c64f4c2389e9389dd2b638c7 to start an election
I20240503 08:12:37.290583 17042 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
from {username='slave'} at 127.0.0.1:41658
I20240503 08:12:37.290750 17042 raft_consensus.cc:482] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:37.290846 17042 raft_consensus.cc:3037] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:37.292774 17042 raft_consensus.cc:504] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:37.293336 17042 leader_election.cc:288] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 3 election: Requested vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:37.293716 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:37.293818 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:37.293896 17116 raft_consensus.cc:3032] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:12:37.294037 17190 raft_consensus.cc:3037] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:37.294060 17116 raft_consensus.cc:729] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Running, Role: LEADER
I20240503 08:12:37.294317 17116 consensus_queue.cc:260] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:37.294647 17116 raft_consensus.cc:3037] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:37.296276 17190 raft_consensus.cc:2454] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 3.
I20240503 08:12:37.296563 17116 raft_consensus.cc:2454] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 3.
I20240503 08:12:37.296708 17005 leader_election.cc:302] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:37.296978 17340 raft_consensus.cc:2781] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:12:37.297098 17340 raft_consensus.cc:686] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 LEADER]: Becoming Leader. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:37.297366 17340 consensus_queue.cc:237] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:37.300191 16938 catalog_manager.cc:5484] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 reported cstate change: term changed from 2 to 3, leader changed from 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66) to adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65). New cstate: current_term: 3 leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:37.370780 17240 raft_consensus.cc:979] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06: : Instructing follower adf8f413c64f4c2389e9389dd2b638c7 to start an election
I20240503 08:12:37.370975 17240 raft_consensus.cc:1067] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Signalling peer adf8f413c64f4c2389e9389dd2b638c7 to start an election
I20240503 08:12:37.371618 17042 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8d3aed7f93894ea1a6edafb5fc4b6632"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
from {username='slave'} at 127.0.0.1:41658
I20240503 08:12:37.371834 17042 raft_consensus.cc:482] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:37.371937 17042 raft_consensus.cc:3037] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:37.375072 17042 raft_consensus.cc:504] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:37.375679 17042 leader_election.cc:288] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 3 election: Requested vote from peers 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:37.376178 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3aed7f93894ea1a6edafb5fc4b6632" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:37.376204 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d3aed7f93894ea1a6edafb5fc4b6632" candidate_uuid: "adf8f413c64f4c2389e9389dd2b638c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:37.376348 17190 raft_consensus.cc:3037] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:37.376381 17116 raft_consensus.cc:3032] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:12:37.376470 17116 raft_consensus.cc:729] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Running, Role: LEADER
I20240503 08:12:37.376703 17116 consensus_queue.cc:260] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:37.377043 17116 raft_consensus.cc:3037] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:37.378429 17190 raft_consensus.cc:2454] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 3.
I20240503 08:12:37.378810 17005 leader_election.cc:302] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, adf8f413c64f4c2389e9389dd2b638c7; no voters:
I20240503 08:12:37.379145 17340 raft_consensus.cc:2781] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:12:37.379169 17116 raft_consensus.cc:2454] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adf8f413c64f4c2389e9389dd2b638c7 in term 3.
I20240503 08:12:37.379314 17340 raft_consensus.cc:686] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 LEADER]: Becoming Leader. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:37.379591 17340 consensus_queue.cc:237] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:37.381798 16938 catalog_manager.cc:5484] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 reported cstate change: term changed from 2 to 3, leader changed from 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66) to adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65). New cstate: current_term: 3 leader_uuid: "adf8f413c64f4c2389e9389dd2b638c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:37.447312 17190 raft_consensus.cc:1261] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 4 FOLLOWER]: Refusing update from remote peer adf8f413c64f4c2389e9389dd2b638c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:12:37.447997 17340 consensus_queue.cc:1035] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:37.451817 17116 raft_consensus.cc:1261] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 4 FOLLOWER]: Refusing update from remote peer adf8f413c64f4c2389e9389dd2b638c7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:12:37.452526 17344 consensus_queue.cc:1035] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:37.776876 17116 raft_consensus.cc:1261] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Refusing update from remote peer adf8f413c64f4c2389e9389dd2b638c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:37.777427 17344 consensus_queue.cc:1035] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:37.777760 17190 raft_consensus.cc:1261] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Refusing update from remote peer adf8f413c64f4c2389e9389dd2b638c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:37.778249 17344 consensus_queue.cc:1035] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:37.781216 17191 raft_consensus.cc:1261] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Refusing update from remote peer adf8f413c64f4c2389e9389dd2b638c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:37.782084 17356 consensus_queue.cc:1035] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:37.784905 17115 raft_consensus.cc:1261] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Refusing update from remote peer adf8f413c64f4c2389e9389dd2b638c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:37.786073 17115 raft_consensus.cc:1261] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Refusing update from remote peer adf8f413c64f4c2389e9389dd2b638c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:37.786301 17340 consensus_queue.cc:1035] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:37.786816 17340 consensus_queue.cc:1035] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:37.796723 17190 raft_consensus.cc:1261] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Refusing update from remote peer adf8f413c64f4c2389e9389dd2b638c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:37.797263 17344 consensus_queue.cc:1035] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:40.021535 16425 auto_leader_rebalancer-test.cc:365] The leader distribution is
I20240503 08:12:40.021792 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:40.023950 17042 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
mode: GRACEFUL
new_leader_uuid: "9ad100ff3b5049f3966c923497e18f06"
from {username='slave'} at 127.0.0.1:37744
I20240503 08:12:40.024147 17042 raft_consensus.cc:595] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 LEADER]: Received request to transfer leadership to TS 9ad100ff3b5049f3966c923497e18f06
I20240503 08:12:40.025035 17042 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "810966f2a982466ca03159edc4b4b35d"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
mode: GRACEFUL
new_leader_uuid: "129772b7c12040808cb9a9fbf09c95c8"
from {username='slave'} at 127.0.0.1:37744
I20240503 08:12:40.025180 17042 raft_consensus.cc:595] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Received request to transfer leadership to TS 129772b7c12040808cb9a9fbf09c95c8
I20240503 08:12:40.025977 17042 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9da6d226e790440eb97f22ade721af57"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
mode: GRACEFUL
new_leader_uuid: "129772b7c12040808cb9a9fbf09c95c8"
from {username='slave'} at 127.0.0.1:37744
I20240503 08:12:40.026119 17042 raft_consensus.cc:595] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 LEADER]: Received request to transfer leadership to TS 129772b7c12040808cb9a9fbf09c95c8
I20240503 08:12:40.026890 17042 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d0ddeaed6b6b46fa8fb5de4cc6b1593d"
dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
mode: GRACEFUL
new_leader_uuid: "9ad100ff3b5049f3966c923497e18f06"
from {username='slave'} at 127.0.0.1:37744
I20240503 08:12:40.027020 17042 raft_consensus.cc:595] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Received request to transfer leadership to TS 9ad100ff3b5049f3966c923497e18f06
I20240503 08:12:40.027420 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 4
I20240503 08:12:40.027587 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:40.055825 17367 raft_consensus.cc:979] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7: : Instructing follower 129772b7c12040808cb9a9fbf09c95c8 to start an election
I20240503 08:12:40.056020 17367 raft_consensus.cc:1067] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Signalling peer 129772b7c12040808cb9a9fbf09c95c8 to start an election
I20240503 08:12:40.056633 17190 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "810966f2a982466ca03159edc4b4b35d"
dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
from {username='slave'} at 127.0.0.1:48978
I20240503 08:12:40.056830 17190 raft_consensus.cc:482] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:40.056934 17190 raft_consensus.cc:3037] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:40.058895 17190 raft_consensus.cc:504] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:40.059746 17190 leader_election.cc:288] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 2 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:40.060184 17042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "810966f2a982466ca03159edc4b4b35d" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:40.060377 17042 raft_consensus.cc:3032] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:12:40.060492 17115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "810966f2a982466ca03159edc4b4b35d" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:40.060655 17115 raft_consensus.cc:3037] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:40.060694 17344 raft_consensus.cc:979] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7: : Instructing follower 9ad100ff3b5049f3966c923497e18f06 to start an election
I20240503 08:12:40.060839 17367 raft_consensus.cc:1067] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Signalling peer 9ad100ff3b5049f3966c923497e18f06 to start an election
I20240503 08:12:40.061401 17116 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d0ddeaed6b6b46fa8fb5de4cc6b1593d"
dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
from {username='slave'} at 127.0.0.1:36816
I20240503 08:12:40.061570 17116 raft_consensus.cc:482] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:40.061697 17116 raft_consensus.cc:3037] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:40.063663 17042 raft_consensus.cc:729] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:40.063872 17115 raft_consensus.cc:2454] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 2.
I20240503 08:12:40.063961 17042 consensus_queue.cc:260] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:40.064327 17157 leader_election.cc:302] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:40.064412 17042 raft_consensus.cc:3037] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:40.064647 17343 raft_consensus.cc:2781] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:12:40.064831 17116 raft_consensus.cc:504] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:40.065078 17343 raft_consensus.cc:686] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 2 LEADER]: Becoming Leader. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:40.065435 17343 consensus_queue.cc:237] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:40.065888 17116 leader_election.cc:288] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 2 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:40.066607 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0ddeaed6b6b46fa8fb5de4cc6b1593d" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:40.066710 17040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0ddeaed6b6b46fa8fb5de4cc6b1593d" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:40.066783 17190 raft_consensus.cc:3037] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:40.066854 17040 raft_consensus.cc:3032] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 08:12:40.066915 17042 raft_consensus.cc:2454] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 2.
I20240503 08:12:40.066915 17040 raft_consensus.cc:729] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:40.067281 17040 consensus_queue.cc:260] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:40.067709 17040 raft_consensus.cc:3037] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 08:12:40.068907 17190 raft_consensus.cc:2454] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 2.
I20240503 08:12:40.069305 17080 leader_election.cc:302] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:40.069603 17366 raft_consensus.cc:2781] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 08:12:40.069998 17366 raft_consensus.cc:686] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Becoming Leader. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Running, Role: LEADER
I20240503 08:12:40.070403 17366 consensus_queue.cc:237] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:40.070673 17040 raft_consensus.cc:2454] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 2.
I20240503 08:12:40.073282 16938 catalog_manager.cc:5484] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 reported cstate change: term changed from 1 to 2, leader changed from adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65) to 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66). New cstate: current_term: 2 leader_uuid: "9ad100ff3b5049f3966c923497e18f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:40.077418 16939 catalog_manager.cc:5484] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 reported cstate change: term changed from 1 to 2, leader changed from adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65) to 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67). New cstate: current_term: 2 leader_uuid: "129772b7c12040808cb9a9fbf09c95c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:40.097048 17344 raft_consensus.cc:979] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7: : Instructing follower 129772b7c12040808cb9a9fbf09c95c8 to start an election
I20240503 08:12:40.097239 17344 raft_consensus.cc:1067] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 LEADER]: Signalling peer 129772b7c12040808cb9a9fbf09c95c8 to start an election
I20240503 08:12:40.097815 17190 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9da6d226e790440eb97f22ade721af57"
dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
from {username='slave'} at 127.0.0.1:48978
I20240503 08:12:40.098016 17190 raft_consensus.cc:482] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:40.098114 17190 raft_consensus.cc:3037] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:40.100031 17190 raft_consensus.cc:504] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:40.100591 17190 leader_election.cc:288] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 3 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66:44441)
I20240503 08:12:40.101073 17040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da6d226e790440eb97f22ade721af57" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:40.101071 17116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da6d226e790440eb97f22ade721af57" candidate_uuid: "129772b7c12040808cb9a9fbf09c95c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
I20240503 08:12:40.101310 17040 raft_consensus.cc:3032] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 08:12:40.101341 17116 raft_consensus.cc:3037] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:40.101401 17040 raft_consensus.cc:729] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:40.101691 17040 consensus_queue.cc:260] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:40.102064 17040 raft_consensus.cc:3037] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Advancing to term 3
I20240503 08:12:40.104105 17116 raft_consensus.cc:2454] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 3.
I20240503 08:12:40.104497 17157 leader_election.cc:302] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:40.104594 17040 raft_consensus.cc:2454] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129772b7c12040808cb9a9fbf09c95c8 in term 3.
I20240503 08:12:40.104759 17343 raft_consensus.cc:2781] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 08:12:40.104914 17343 raft_consensus.cc:686] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 LEADER]: Becoming Leader. State: Replica: 129772b7c12040808cb9a9fbf09c95c8, State: Running, Role: LEADER
I20240503 08:12:40.105172 17343 consensus_queue.cc:237] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:40.107599 16939 catalog_manager.cc:5484] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 reported cstate change: term changed from 2 to 3, leader changed from adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65) to 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67). New cstate: current_term: 3 leader_uuid: "129772b7c12040808cb9a9fbf09c95c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:40.250463 17367 raft_consensus.cc:979] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7: : Instructing follower 9ad100ff3b5049f3966c923497e18f06 to start an election
I20240503 08:12:40.250634 17367 raft_consensus.cc:1067] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 LEADER]: Signalling peer 9ad100ff3b5049f3966c923497e18f06 to start an election
I20240503 08:12:40.251178 17116 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5"
dest_uuid: "9ad100ff3b5049f3966c923497e18f06"
from {username='slave'} at 127.0.0.1:36816
I20240503 08:12:40.251360 17116 raft_consensus.cc:482] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 08:12:40.251499 17116 raft_consensus.cc:3037] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:40.253346 17116 raft_consensus.cc:504] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:40.253907 17116 leader_election.cc:288] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 4 election: Requested vote from peers adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509), 129772b7c12040808cb9a9fbf09c95c8 (127.16.10.67:40555)
I20240503 08:12:40.254307 17040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "adf8f413c64f4c2389e9389dd2b638c7"
I20240503 08:12:40.254350 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c52979c9d154024a1940cfd04b0ecd5" candidate_uuid: "9ad100ff3b5049f3966c923497e18f06" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "129772b7c12040808cb9a9fbf09c95c8"
I20240503 08:12:40.254509 17190 raft_consensus.cc:3037] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:40.254516 17040 raft_consensus.cc:3032] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 LEADER]: Stepping down as leader of term 3
I20240503 08:12:40.254642 17040 raft_consensus.cc:729] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adf8f413c64f4c2389e9389dd2b638c7, State: Running, Role: LEADER
I20240503 08:12:40.254911 17040 consensus_queue.cc:260] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:40.255225 17040 raft_consensus.cc:3037] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Advancing to term 4
I20240503 08:12:40.257079 17190 raft_consensus.cc:2454] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 4.
I20240503 08:12:40.257475 17080 leader_election.cc:302] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129772b7c12040808cb9a9fbf09c95c8, 9ad100ff3b5049f3966c923497e18f06; no voters:
I20240503 08:12:40.257712 17366 raft_consensus.cc:2781] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 08:12:40.257712 17040 raft_consensus.cc:2454] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ad100ff3b5049f3966c923497e18f06 in term 4.
I20240503 08:12:40.257920 17366 raft_consensus.cc:686] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 4 LEADER]: Becoming Leader. State: Replica: 9ad100ff3b5049f3966c923497e18f06, State: Running, Role: LEADER
I20240503 08:12:40.258169 17366 consensus_queue.cc:237] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } }
I20240503 08:12:40.260452 16939 catalog_manager.cc:5484] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 reported cstate change: term changed from 3 to 4, leader changed from adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65) to 9ad100ff3b5049f3966c923497e18f06 (127.16.10.66). New cstate: current_term: 4 leader_uuid: "9ad100ff3b5049f3966c923497e18f06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:40.483614 17190 raft_consensus.cc:1261] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Refusing update from remote peer 9ad100ff3b5049f3966c923497e18f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:40.484186 17366 consensus_queue.cc:1035] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:40.488021 17040 raft_consensus.cc:1261] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Refusing update from remote peer 9ad100ff3b5049f3966c923497e18f06: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:40.488606 17380 consensus_queue.cc:1035] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:40.567719 17040 raft_consensus.cc:1261] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Refusing update from remote peer 129772b7c12040808cb9a9fbf09c95c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:40.568253 17343 consensus_queue.cc:1035] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:40.572237 17116 raft_consensus.cc:1261] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Refusing update from remote peer 129772b7c12040808cb9a9fbf09c95c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 08:12:40.572818 17368 consensus_queue.cc:1035] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:40.589044 17040 raft_consensus.cc:1261] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Refusing update from remote peer 129772b7c12040808cb9a9fbf09c95c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:40.589690 17368 consensus_queue.cc:1035] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:40.593573 17116 raft_consensus.cc:1261] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Refusing update from remote peer 129772b7c12040808cb9a9fbf09c95c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 08:12:40.594444 17385 consensus_queue.cc:1035] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ad100ff3b5049f3966c923497e18f06" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:40.690773 17040 raft_consensus.cc:1261] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 4 FOLLOWER]: Refusing update from remote peer 9ad100ff3b5049f3966c923497e18f06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:12:40.691346 17380 consensus_queue.cc:1035] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf8f413c64f4c2389e9389dd2b638c7" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:40.695636 17190 raft_consensus.cc:1261] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 4 FOLLOWER]: Refusing update from remote peer 9ad100ff3b5049f3966c923497e18f06: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 08:12:40.696261 17380 consensus_queue.cc:1035] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129772b7c12040808cb9a9fbf09c95c8" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:41.027920 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:41.029733 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:41.029927 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:42.030331 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:42.031957 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:42.032150 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:43.032487 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:43.034104 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:43.034286 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:44.034696 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:44.036448 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:44.036691 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:45.037156 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:45.039085 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:45.039273 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:46.039698 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:46.041548 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:46.041723 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:47.044912 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:47.046439 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:47.046593 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:48.047006 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:48.049085 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:48.049273 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:49.049680 16425 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 08:12:49.051303 16425 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 08:12:49.051530 16425 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 08:12:50.061764 16425 auto_leader_rebalancer-test.cc:376] The leader distribution is
I20240503 08:12:50.061977 16425 tablet_server.cc:178] TabletServer@127.16.10.65:0 shutting down...
I20240503 08:12:50.070828 16425 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 08:12:50.071091 16425 tablet_replica.cc:330] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7: stopping tablet replica
I20240503 08:12:50.071277 16425 raft_consensus.cc:2229] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.071501 16425 raft_consensus.cc:2258] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.072068 16425 tablet_replica.cc:330] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7: stopping tablet replica
I20240503 08:12:50.072216 16425 raft_consensus.cc:2229] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 4 LEADER]: Raft consensus shutting down.
I20240503 08:12:50.072467 16425 raft_consensus.cc:2258] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P adf8f413c64f4c2389e9389dd2b638c7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.072890 16425 tablet_replica.cc:330] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7: stopping tablet replica
I20240503 08:12:50.073020 16425 raft_consensus.cc:2229] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.073150 16425 raft_consensus.cc:2258] T 2c52979c9d154024a1940cfd04b0ecd5 P adf8f413c64f4c2389e9389dd2b638c7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.073526 16425 tablet_replica.cc:330] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7: stopping tablet replica
I20240503 08:12:50.073652 16425 raft_consensus.cc:2229] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 1 LEADER]: Raft consensus shutting down.
I20240503 08:12:50.073848 16425 raft_consensus.cc:2258] T 8fb4aa868b8642378606d84949c3559c P adf8f413c64f4c2389e9389dd2b638c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.074216 16425 tablet_replica.cc:330] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7: stopping tablet replica
I20240503 08:12:50.074326 16425 raft_consensus.cc:2229] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.074465 16425 raft_consensus.cc:2258] T 98deac96b39c4913a453310aef642721 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.074808 16425 tablet_replica.cc:330] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7: stopping tablet replica
I20240503 08:12:50.074924 16425 raft_consensus.cc:2229] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.075030 16425 raft_consensus.cc:2258] T 9da6d226e790440eb97f22ade721af57 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.075436 16425 tablet_replica.cc:330] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7: stopping tablet replica
I20240503 08:12:50.075547 16425 raft_consensus.cc:2229] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.075670 16425 raft_consensus.cc:2258] T 810966f2a982466ca03159edc4b4b35d P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.076004 16425 tablet_replica.cc:330] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7: stopping tablet replica
I20240503 08:12:50.076117 16425 raft_consensus.cc:2229] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.076226 16425 raft_consensus.cc:2258] T d4f2725a98274d7e85fdfd2c1bc8df10 P adf8f413c64f4c2389e9389dd2b638c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.076591 16425 tablet_replica.cc:330] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7: stopping tablet replica
I20240503 08:12:50.076689 16425 raft_consensus.cc:2229] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 3 LEADER]: Raft consensus shutting down.
I20240503 08:12:50.076894 16425 raft_consensus.cc:2258] T 28fa7c15a1924e0d87ec1a5dbc01a60c P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.077246 16425 tablet_replica.cc:330] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7: stopping tablet replica
I20240503 08:12:50.077361 16425 raft_consensus.cc:2229] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 LEADER]: Raft consensus shutting down.
I20240503 08:12:50.077551 16425 raft_consensus.cc:2258] T 8d3aed7f93894ea1a6edafb5fc4b6632 P adf8f413c64f4c2389e9389dd2b638c7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20240503 08:12:50.091709 17083 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.10.65:39509: connect: Connection refused (error 111)
W20240503 08:12:50.093077 17083 consensus_peers.cc:485] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 -> Peer adf8f413c64f4c2389e9389dd2b638c7 (127.16.10.65:39509): Couldn't send request to peer adf8f413c64f4c2389e9389dd2b638c7. Status: Network error: Client connection negotiation failed: client connection to 127.16.10.65:39509: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240503 08:12:50.093180 16425 tablet_server.cc:194] TabletServer@127.16.10.65:0 shutdown complete.
I20240503 08:12:50.097168 16425 tablet_server.cc:178] TabletServer@127.16.10.66:0 shutting down...
I20240503 08:12:50.113526 16425 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 08:12:50.113804 16425 tablet_replica.cc:330] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06: stopping tablet replica
I20240503 08:12:50.113982 16425 raft_consensus.cc:2229] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.114176 16425 raft_consensus.cc:2258] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 9ad100ff3b5049f3966c923497e18f06 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.114724 16425 tablet_replica.cc:330] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06: stopping tablet replica
I20240503 08:12:50.114841 16425 raft_consensus.cc:2229] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:12:50.115110 16425 raft_consensus.cc:2258] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.115545 16425 tablet_replica.cc:330] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06: stopping tablet replica
I20240503 08:12:50.115659 16425 raft_consensus.cc:2229] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 4 LEADER]: Raft consensus shutting down.
I20240503 08:12:50.115883 16425 raft_consensus.cc:2258] T 2c52979c9d154024a1940cfd04b0ecd5 P 9ad100ff3b5049f3966c923497e18f06 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.116266 16425 tablet_replica.cc:330] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06: stopping tablet replica
I20240503 08:12:50.116379 16425 raft_consensus.cc:2229] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.116495 16425 raft_consensus.cc:2258] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.116850 16425 tablet_replica.cc:330] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06: stopping tablet replica
I20240503 08:12:50.116961 16425 raft_consensus.cc:2229] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.117079 16425 raft_consensus.cc:2258] T 810966f2a982466ca03159edc4b4b35d P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.117430 16425 tablet_replica.cc:330] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06: stopping tablet replica
I20240503 08:12:50.117530 16425 raft_consensus.cc:2229] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.117652 16425 raft_consensus.cc:2258] T d4f2725a98274d7e85fdfd2c1bc8df10 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.118055 16425 tablet_replica.cc:330] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06: stopping tablet replica
I20240503 08:12:50.118170 16425 raft_consensus.cc:2229] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:12:50.118459 16425 raft_consensus.cc:2258] T 98deac96b39c4913a453310aef642721 P 9ad100ff3b5049f3966c923497e18f06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.118925 16425 tablet_replica.cc:330] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06: stopping tablet replica
I20240503 08:12:50.119043 16425 raft_consensus.cc:2229] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.119166 16425 raft_consensus.cc:2258] T 8fb4aa868b8642378606d84949c3559c P 9ad100ff3b5049f3966c923497e18f06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.119635 16425 tablet_replica.cc:330] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06: stopping tablet replica
I20240503 08:12:50.119740 16425 raft_consensus.cc:2229] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.119860 16425 raft_consensus.cc:2258] T 9da6d226e790440eb97f22ade721af57 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.120222 16425 tablet_replica.cc:330] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06: stopping tablet replica
I20240503 08:12:50.120321 16425 raft_consensus.cc:2229] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.120432 16425 raft_consensus.cc:2258] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 9ad100ff3b5049f3966c923497e18f06 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.136587 16425 tablet_server.cc:194] TabletServer@127.16.10.66:0 shutdown complete.
I20240503 08:12:50.140712 16425 tablet_server.cc:178] TabletServer@127.16.10.67:0 shutting down...
I20240503 08:12:50.149016 16425 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 08:12:50.149374 16425 tablet_replica.cc:330] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8: stopping tablet replica
I20240503 08:12:50.149592 16425 raft_consensus.cc:2229] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 LEADER]: Raft consensus shutting down.
I20240503 08:12:50.149907 16425 raft_consensus.cc:2258] T 9da6d226e790440eb97f22ade721af57 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.150482 16425 tablet_replica.cc:330] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8: stopping tablet replica
I20240503 08:12:50.150610 16425 raft_consensus.cc:2229] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:12:50.150840 16425 raft_consensus.cc:2258] T 810966f2a982466ca03159edc4b4b35d P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.151247 16425 tablet_replica.cc:330] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8: stopping tablet replica
I20240503 08:12:50.151361 16425 raft_consensus.cc:2229] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 LEADER]: Raft consensus shutting down.
I20240503 08:12:50.151579 16425 raft_consensus.cc:2258] T d4f2725a98274d7e85fdfd2c1bc8df10 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.151968 16425 tablet_replica.cc:330] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8: stopping tablet replica
I20240503 08:12:50.152079 16425 raft_consensus.cc:2229] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.152209 16425 raft_consensus.cc:2258] T 2c52979c9d154024a1940cfd04b0ecd5 P 129772b7c12040808cb9a9fbf09c95c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.152565 16425 tablet_replica.cc:330] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8: stopping tablet replica
I20240503 08:12:50.152673 16425 raft_consensus.cc:2229] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.152782 16425 raft_consensus.cc:2258] T 28fa7c15a1924e0d87ec1a5dbc01a60c P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.153143 16425 tablet_replica.cc:330] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8: stopping tablet replica
I20240503 08:12:50.153252 16425 raft_consensus.cc:2229] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.153367 16425 raft_consensus.cc:2258] T 8fb4aa868b8642378606d84949c3559c P 129772b7c12040808cb9a9fbf09c95c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.153710 16425 tablet_replica.cc:330] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8: stopping tablet replica
I20240503 08:12:50.153815 16425 raft_consensus.cc:2229] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.153932 16425 raft_consensus.cc:2258] T 98deac96b39c4913a453310aef642721 P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.154278 16425 tablet_replica.cc:330] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8: stopping tablet replica
I20240503 08:12:50.154381 16425 raft_consensus.cc:2229] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.154487 16425 raft_consensus.cc:2258] T 4f5aecc555e9496eba7f9bc5d67bdbd1 P 129772b7c12040808cb9a9fbf09c95c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.154829 16425 tablet_replica.cc:330] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8: stopping tablet replica
I20240503 08:12:50.154937 16425 raft_consensus.cc:2229] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.155046 16425 raft_consensus.cc:2258] T d0ddeaed6b6b46fa8fb5de4cc6b1593d P 129772b7c12040808cb9a9fbf09c95c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.155467 16425 tablet_replica.cc:330] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8: stopping tablet replica
I20240503 08:12:50.155571 16425 raft_consensus.cc:2229] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:50.155692 16425 raft_consensus.cc:2258] T 8d3aed7f93894ea1a6edafb5fc4b6632 P 129772b7c12040808cb9a9fbf09c95c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.170411 16425 tablet_server.cc:194] TabletServer@127.16.10.67:0 shutdown complete.
I20240503 08:12:50.179291 16425 master.cc:537] Master@127.16.10.126:41683 shutting down...
I20240503 08:12:50.186126 16425 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [term 1 LEADER]: Raft consensus shutting down.
I20240503 08:12:50.186349 16425 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:50.186439 16425 tablet_replica.cc:330] T 00000000000000000000000000000000 P 017f7fffcfcf43b296aa9382d498a895: stopping tablet replica
I20240503 08:12:50.199174 16425 master.cc:552] Master@127.16.10.126:41683 shutdown complete.
129772b7c12040808cb9a9fbf09c95c8 1
9ad100ff3b5049f3966c923497e18f06 4
adf8f413c64f4c2389e9389dd2b638c7 5
129772b7c12040808cb9a9fbf09c95c8 3
9ad100ff3b5049f3966c923497e18f06 3
adf8f413c64f4c2389e9389dd2b638c7 4
129772b7c12040808cb9a9fbf09c95c8 1
9ad100ff3b5049f3966c923497e18f06 1
adf8f413c64f4c2389e9389dd2b638c7 8
129772b7c12040808cb9a9fbf09c95c8 3
9ad100ff3b5049f3966c923497e18f06 3
adf8f413c64f4c2389e9389dd2b638c7 4
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (27194 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20240503 08:12:50.213737 16425 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.10.126:46597
I20240503 08:12:50.214213 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:12:50.216892 17402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:50.217515 17403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:50.218153 17405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:12:50.218644 16425 server_base.cc:1034] running on GCE node
I20240503 08:12:50.218887 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:12:50.218936 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:12:50.218964 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723970218960 us; error 0 us; skew 500 ppm
I20240503 08:12:50.219118 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:12:50.220424 16425 webserver.cc:460] Webserver started at http://127.16.10.126:33745/ using document root <none> and password file <none>
I20240503 08:12:50.220628 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:12:50.220685 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:12:50.220798 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:12:50.221375 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/master-0-root/instance:
uuid: "e8fa7872e7e746e89947a0e7387d1493"
format_stamp: "Formatted at 2024-05-03 08:12:50 on dist-test-slave-6p8x"
I20240503 08:12:50.223726 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240503 08:12:50.225170 17410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:50.225481 16425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:12:50.225569 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/master-0-root
uuid: "e8fa7872e7e746e89947a0e7387d1493"
format_stamp: "Formatted at 2024-05-03 08:12:50 on dist-test-slave-6p8x"
I20240503 08:12:50.225664 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:12:50.242421 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:12:50.242925 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:12:50.255915 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.126:46597
I20240503 08:12:50.255954 17461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.126:46597 every 8 connection(s)
I20240503 08:12:50.257172 17462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.261212 17462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493: Bootstrap starting.
I20240503 08:12:50.262470 17462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:50.264020 17462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493: No bootstrap required, opened a new log
I20240503 08:12:50.264613 17462 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8fa7872e7e746e89947a0e7387d1493" member_type: VOTER }
I20240503 08:12:50.264740 17462 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:50.264791 17462 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8fa7872e7e746e89947a0e7387d1493, State: Initialized, Role: FOLLOWER
I20240503 08:12:50.264974 17462 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8fa7872e7e746e89947a0e7387d1493" member_type: VOTER }
I20240503 08:12:50.265080 17462 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 08:12:50.265130 17462 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 08:12:50.265197 17462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:50.266911 17462 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8fa7872e7e746e89947a0e7387d1493" member_type: VOTER }
I20240503 08:12:50.267083 17462 leader_election.cc:302] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8fa7872e7e746e89947a0e7387d1493; no voters:
I20240503 08:12:50.267472 17462 leader_election.cc:288] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 08:12:50.267567 17465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:50.267966 17465 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [term 1 LEADER]: Becoming Leader. State: Replica: e8fa7872e7e746e89947a0e7387d1493, State: Running, Role: LEADER
I20240503 08:12:50.268198 17465 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8fa7872e7e746e89947a0e7387d1493" member_type: VOTER }
I20240503 08:12:50.268254 17462 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 08:12:50.268949 17467 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8fa7872e7e746e89947a0e7387d1493. Latest consensus state: current_term: 1 leader_uuid: "e8fa7872e7e746e89947a0e7387d1493" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8fa7872e7e746e89947a0e7387d1493" member_type: VOTER } }
I20240503 08:12:50.269088 17467 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [sys.catalog]: This master's current role is: LEADER
I20240503 08:12:50.269109 17466 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8fa7872e7e746e89947a0e7387d1493" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8fa7872e7e746e89947a0e7387d1493" member_type: VOTER } }
I20240503 08:12:50.269281 17466 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493 [sys.catalog]: This master's current role is: LEADER
I20240503 08:12:50.270222 17470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 08:12:50.271564 17470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 08:12:50.273138 16425 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240503 08:12:50.274252 17470 catalog_manager.cc:1347] Generated new cluster ID: 5443663c6b404816bf1ee318c4a9bf86
I20240503 08:12:50.274338 17470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 08:12:50.280505 17470 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 08:12:50.281198 17470 catalog_manager.cc:1504] Loading token signing keys...
I20240503 08:12:50.294678 17470 catalog_manager.cc:5857] T 00000000000000000000000000000000 P e8fa7872e7e746e89947a0e7387d1493: Generated new TSK 0
I20240503 08:12:50.294890 17470 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 08:12:50.305732 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:12:50.308656 17483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:50.309018 17484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:50.309523 17486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:12:50.310343 16425 server_base.cc:1034] running on GCE node
I20240503 08:12:50.310595 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:12:50.310652 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:12:50.310686 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723970310682 us; error 0 us; skew 500 ppm
I20240503 08:12:50.310828 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:12:50.316967 16425 webserver.cc:460] Webserver started at http://127.16.10.65:44955/ using document root <none> and password file <none>
I20240503 08:12:50.317193 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:12:50.317253 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:12:50.317365 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:12:50.317978 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-0-root/instance:
uuid: "06335016e7f84df18efcdfacbab289b2"
format_stamp: "Formatted at 2024-05-03 08:12:50 on dist-test-slave-6p8x"
I20240503 08:12:50.320431 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20240503 08:12:50.321792 17491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:50.322142 16425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:12:50.322235 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-0-root
uuid: "06335016e7f84df18efcdfacbab289b2"
format_stamp: "Formatted at 2024-05-03 08:12:50 on dist-test-slave-6p8x"
I20240503 08:12:50.322332 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:12:50.327785 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:12:50.328207 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:12:50.328649 16425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:12:50.329406 16425 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:12:50.329457 16425 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:50.329509 16425 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:12:50.329536 16425 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:50.342151 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.65:41725
I20240503 08:12:50.342175 17553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.65:41725 every 8 connection(s)
I20240503 08:12:50.343731 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:12:50.346843 17558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:50.347456 17559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:50.348102 17561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:12:50.348524 16425 server_base.cc:1034] running on GCE node
I20240503 08:12:50.348799 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:12:50.348855 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:12:50.348884 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723970348881 us; error 0 us; skew 500 ppm
I20240503 08:12:50.349025 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:12:50.350498 16425 webserver.cc:460] Webserver started at http://127.16.10.66:44687/ using document root <none> and password file <none>
I20240503 08:12:50.350555 17554 heartbeater.cc:347] Connected to a master server at 127.16.10.126:46597
I20240503 08:12:50.350674 17554 heartbeater.cc:464] Registering TS with master...
I20240503 08:12:50.350747 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:12:50.350821 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:12:50.350939 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:12:50.351063 17554 heartbeater.cc:511] Master 127.16.10.126:46597 requested a full tablet report, sending...
I20240503 08:12:50.351631 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-1-root/instance:
uuid: "69ebcf1734b949a19671e604e9a54cec"
format_stamp: "Formatted at 2024-05-03 08:12:50 on dist-test-slave-6p8x"
I20240503 08:12:50.351922 17427 ts_manager.cc:194] Registered new tserver with Master: 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725)
I20240503 08:12:50.352909 17427 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44444
I20240503 08:12:50.354125 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20240503 08:12:50.355495 17566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:50.355839 16425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:12:50.355922 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-1-root
uuid: "69ebcf1734b949a19671e604e9a54cec"
format_stamp: "Formatted at 2024-05-03 08:12:50 on dist-test-slave-6p8x"
I20240503 08:12:50.356003 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:12:50.369463 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:12:50.369947 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:12:50.370453 16425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:12:50.371204 16425 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:12:50.371258 16425 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:50.371325 16425 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:12:50.371368 16425 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:50.382999 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.66:39107
I20240503 08:12:50.383035 17628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.66:39107 every 8 connection(s)
I20240503 08:12:50.384435 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 08:12:50.387349 17632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:50.387938 17633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:50.388444 17635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:12:50.389045 16425 server_base.cc:1034] running on GCE node
I20240503 08:12:50.389323 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:12:50.389389 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:12:50.389427 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723970389423 us; error 0 us; skew 500 ppm
I20240503 08:12:50.389571 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:12:50.390578 17629 heartbeater.cc:347] Connected to a master server at 127.16.10.126:46597
I20240503 08:12:50.390695 17629 heartbeater.cc:464] Registering TS with master...
I20240503 08:12:50.390976 17629 heartbeater.cc:511] Master 127.16.10.126:46597 requested a full tablet report, sending...
I20240503 08:12:50.391355 16425 webserver.cc:460] Webserver started at http://127.16.10.67:39745/ using document root <none> and password file <none>
I20240503 08:12:50.391593 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:12:50.391662 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:12:50.391772 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:12:50.391808 17427 ts_manager.cc:194] Registered new tserver with Master: 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:50.392331 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-2-root/instance:
uuid: "0d15e9450254455f8e3a1d2b194661a2"
format_stamp: "Formatted at 2024-05-03 08:12:50 on dist-test-slave-6p8x"
I20240503 08:12:50.392541 17427 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44450
I20240503 08:12:50.394641 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240503 08:12:50.396076 17640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:50.396414 16425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 08:12:50.396502 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-2-root
uuid: "0d15e9450254455f8e3a1d2b194661a2"
format_stamp: "Formatted at 2024-05-03 08:12:50 on dist-test-slave-6p8x"
I20240503 08:12:50.396584 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:12:50.413089 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:12:50.413707 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:12:50.414395 16425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:12:50.415246 16425 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:12:50.415300 16425 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:50.415369 16425 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:12:50.415422 16425 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:50.429075 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.67:45843
I20240503 08:12:50.429109 17702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.67:45843 every 8 connection(s)
I20240503 08:12:50.435174 17703 heartbeater.cc:347] Connected to a master server at 127.16.10.126:46597
I20240503 08:12:50.435305 17703 heartbeater.cc:464] Registering TS with master...
I20240503 08:12:50.435681 17703 heartbeater.cc:511] Master 127.16.10.126:46597 requested a full tablet report, sending...
I20240503 08:12:50.436429 17427 ts_manager.cc:194] Registered new tserver with Master: 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:50.436684 16425 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.006764134s
I20240503 08:12:50.437191 17427 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44456
I20240503 08:12:50.437569 16425 test_util.cc:268] Using random seed: 1227182523
I20240503 08:12:50.448192 17427 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44460:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240503 08:12:50.449496 17427 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240503 08:12:50.506793 17668 tablet_service.cc:1467] Processing CreateTablet for tablet 0eb6ec2d5ea544a3803f1f5e456901a3 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240503 08:12:50.507350 17668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0eb6ec2d5ea544a3803f1f5e456901a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.507599 17593 tablet_service.cc:1467] Processing CreateTablet for tablet cf8db1fd73474fe2ad968e53f0ab71ae (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240503 08:12:50.507969 17593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf8db1fd73474fe2ad968e53f0ab71ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.511791 17594 tablet_service.cc:1467] Processing CreateTablet for tablet 0eb6ec2d5ea544a3803f1f5e456901a3 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240503 08:12:50.512056 17519 tablet_service.cc:1467] Processing CreateTablet for tablet 0eb6ec2d5ea544a3803f1f5e456901a3 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240503 08:12:50.512207 17594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0eb6ec2d5ea544a3803f1f5e456901a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.512245 17518 tablet_service.cc:1467] Processing CreateTablet for tablet cf8db1fd73474fe2ad968e53f0ab71ae (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240503 08:12:50.512403 17519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0eb6ec2d5ea544a3803f1f5e456901a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.512634 17518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf8db1fd73474fe2ad968e53f0ab71ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.512972 17591 tablet_service.cc:1467] Processing CreateTablet for tablet 14377788ca9f4bb4af727da959857d9c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240503 08:12:50.513339 17591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14377788ca9f4bb4af727da959857d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.515774 17592 tablet_service.cc:1467] Processing CreateTablet for tablet 5e5a4235b0d0427cb308ae894cb0b00a (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240503 08:12:50.516139 17592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e5a4235b0d0427cb308ae894cb0b00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.518318 17718 tablet_bootstrap.cc:492] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:50.518399 17517 tablet_service.cc:1467] Processing CreateTablet for tablet 5e5a4235b0d0427cb308ae894cb0b00a (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240503 08:12:50.518775 17517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e5a4235b0d0427cb308ae894cb0b00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.519188 17589 tablet_service.cc:1467] Processing CreateTablet for tablet f2057a35eb684e41bac23078e6526b08 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240503 08:12:50.519608 17589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2057a35eb684e41bac23078e6526b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.519754 17590 tablet_service.cc:1467] Processing CreateTablet for tablet 2ee11da8ed904a74b46369a40ba83af8 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240503 08:12:50.520016 17718 tablet_bootstrap.cc:654] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:50.520131 17590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ee11da8ed904a74b46369a40ba83af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.523078 17587 tablet_service.cc:1467] Processing CreateTablet for tablet b0dd68775f514b6b983f28fd87d9e4ec (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240503 08:12:50.523473 17587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0dd68775f514b6b983f28fd87d9e4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.523701 17588 tablet_service.cc:1467] Processing CreateTablet for tablet 39f868a4bdfb403fa462b79cc5507546 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240503 08:12:50.524063 17588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39f868a4bdfb403fa462b79cc5507546. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.526103 17515 tablet_service.cc:1467] Processing CreateTablet for tablet 2ee11da8ed904a74b46369a40ba83af8 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240503 08:12:50.526505 17515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ee11da8ed904a74b46369a40ba83af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.527734 17586 tablet_service.cc:1467] Processing CreateTablet for tablet 14598a4f2af1413b835d50517b27f305 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240503 08:12:50.528064 17586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14598a4f2af1413b835d50517b27f305. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.531711 17585 tablet_service.cc:1467] Processing CreateTablet for tablet 761ee807456f4691bb8ae39350bff31c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240503 08:12:50.532049 17585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 761ee807456f4691bb8ae39350bff31c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.533336 17514 tablet_service.cc:1467] Processing CreateTablet for tablet f2057a35eb684e41bac23078e6526b08 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240503 08:12:50.533779 17514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2057a35eb684e41bac23078e6526b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.534466 17589 tablet_service.cc:1467] Processing CreateTablet for tablet 519eb7f46c59460ba3b4a5613ff54894 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240503 08:12:50.534793 17589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 519eb7f46c59460ba3b4a5613ff54894. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.524073 17516 tablet_service.cc:1467] Processing CreateTablet for tablet 14377788ca9f4bb4af727da959857d9c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240503 08:12:50.536231 17516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14377788ca9f4bb4af727da959857d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.536370 17511 tablet_service.cc:1467] Processing CreateTablet for tablet 761ee807456f4691bb8ae39350bff31c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240503 08:12:50.536780 17511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 761ee807456f4691bb8ae39350bff31c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.537993 17593 tablet_service.cc:1467] Processing CreateTablet for tablet b5726229454f477d8e526198ede45aab (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240503 08:12:50.538322 17593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5726229454f477d8e526198ede45aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.537581 17518 tablet_service.cc:1467] Processing CreateTablet for tablet b5726229454f477d8e526198ede45aab (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240503 08:12:50.538586 17518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5726229454f477d8e526198ede45aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.538178 17517 tablet_service.cc:1467] Processing CreateTablet for tablet aee53c998fb44359b24cb8bf1e9ae658 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240503 08:12:50.538976 17517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee53c998fb44359b24cb8bf1e9ae658. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.539744 17513 tablet_service.cc:1467] Processing CreateTablet for tablet b0dd68775f514b6b983f28fd87d9e4ec (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240503 08:12:50.540124 17513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0dd68775f514b6b983f28fd87d9e4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.541847 17587 tablet_service.cc:1467] Processing CreateTablet for tablet aee53c998fb44359b24cb8bf1e9ae658 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240503 08:12:50.542196 17587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee53c998fb44359b24cb8bf1e9ae658. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.543052 17592 tablet_service.cc:1467] Processing CreateTablet for tablet db0fbf6819374978ab404bbfde4b9d42 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240503 08:12:50.543718 17510 tablet_service.cc:1467] Processing CreateTablet for tablet 519eb7f46c59460ba3b4a5613ff54894 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240503 08:12:50.553830 17510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 519eb7f46c59460ba3b4a5613ff54894. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.555265 17593 tablet_service.cc:1467] Processing CreateTablet for tablet dc6b261ca02d4cfe89b131c0ad46c8d2 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240503 08:12:50.545068 17519 tablet_service.cc:1467] Processing CreateTablet for tablet db0fbf6819374978ab404bbfde4b9d42 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240503 08:12:50.545821 17516 tablet_service.cc:1467] Processing CreateTablet for tablet 675688b228f147f8a88e69f43b91ef0c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240503 08:12:50.562636 17593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc6b261ca02d4cfe89b131c0ad46c8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.562767 17516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 675688b228f147f8a88e69f43b91ef0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.548475 17590 tablet_service.cc:1467] Processing CreateTablet for tablet 675688b228f147f8a88e69f43b91ef0c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240503 08:12:50.551769 17513 tablet_service.cc:1467] Processing CreateTablet for tablet dc6b261ca02d4cfe89b131c0ad46c8d2 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240503 08:12:50.552070 17514 tablet_service.cc:1467] Processing CreateTablet for tablet 01c1231eca744af282822464f9af362e (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240503 08:12:50.563457 17590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 675688b228f147f8a88e69f43b91ef0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.563661 17514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01c1231eca744af282822464f9af362e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.552439 17515 tablet_service.cc:1467] Processing CreateTablet for tablet 39f868a4bdfb403fa462b79cc5507546 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240503 08:12:50.553319 17588 tablet_service.cc:1467] Processing CreateTablet for tablet 01c1231eca744af282822464f9af362e (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240503 08:12:50.564672 17588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01c1231eca744af282822464f9af362e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.557564 17517 tablet_service.cc:1467] Processing CreateTablet for tablet 5f95209235434aa0aa22bb6fff89bbb5 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240503 08:12:50.558766 17518 tablet_service.cc:1467] Processing CreateTablet for tablet 979822ec7a3842248c37ee6ec6bf618c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240503 08:12:50.539758 17512 tablet_service.cc:1467] Processing CreateTablet for tablet 14598a4f2af1413b835d50517b27f305 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240503 08:12:50.560014 17510 tablet_service.cc:1467] Processing CreateTablet for tablet f131aca1d2274b0ba4df3499cd835616 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240503 08:12:50.560900 17719 tablet_bootstrap.cc:492] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:50.560989 17591 tablet_service.cc:1467] Processing CreateTablet for tablet 5f95209235434aa0aa22bb6fff89bbb5 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240503 08:12:50.561587 17589 tablet_service.cc:1467] Processing CreateTablet for tablet 979822ec7a3842248c37ee6ec6bf618c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240503 08:12:50.561834 17585 tablet_service.cc:1467] Processing CreateTablet for tablet f131aca1d2274b0ba4df3499cd835616 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240503 08:12:50.562250 17587 tablet_service.cc:1467] Processing CreateTablet for tablet 4afbd55d9ebb4908adb04063270ddcba (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240503 08:12:50.563889 17519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db0fbf6819374978ab404bbfde4b9d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.567155 17586 tablet_service.cc:1467] Processing CreateTablet for tablet cf0faa2ea34146b48c0842a7878e20f3 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240503 08:12:50.567620 17586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0faa2ea34146b48c0842a7878e20f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.567793 17513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc6b261ca02d4cfe89b131c0ad46c8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.568333 17719 tablet_bootstrap.cc:654] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:50.568435 17589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 979822ec7a3842248c37ee6ec6bf618c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.568603 17585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f131aca1d2274b0ba4df3499cd835616. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.568996 17592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db0fbf6819374978ab404bbfde4b9d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.569645 17591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f95209235434aa0aa22bb6fff89bbb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.569736 17515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39f868a4bdfb403fa462b79cc5507546. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.570168 17587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4afbd55d9ebb4908adb04063270ddcba. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.571676 17518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 979822ec7a3842248c37ee6ec6bf618c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.571846 17510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f131aca1d2274b0ba4df3499cd835616. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.572202 17517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f95209235434aa0aa22bb6fff89bbb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.571327 17667 tablet_service.cc:1467] Processing CreateTablet for tablet cf8db1fd73474fe2ad968e53f0ab71ae (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240503 08:12:50.573999 17511 tablet_service.cc:1467] Processing CreateTablet for tablet 4afbd55d9ebb4908adb04063270ddcba (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240503 08:12:50.575091 17667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf8db1fd73474fe2ad968e53f0ab71ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.587659 17511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4afbd55d9ebb4908adb04063270ddcba. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.588543 17665 tablet_service.cc:1467] Processing CreateTablet for tablet 14377788ca9f4bb4af727da959857d9c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240503 08:12:50.589303 17512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14598a4f2af1413b835d50517b27f305. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.590168 17666 tablet_service.cc:1467] Processing CreateTablet for tablet 5e5a4235b0d0427cb308ae894cb0b00a (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240503 08:12:50.595520 17665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14377788ca9f4bb4af727da959857d9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.598188 17660 tablet_service.cc:1467] Processing CreateTablet for tablet 14598a4f2af1413b835d50517b27f305 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240503 08:12:50.600950 17663 tablet_service.cc:1467] Processing CreateTablet for tablet f2057a35eb684e41bac23078e6526b08 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240503 08:12:50.601521 17666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e5a4235b0d0427cb308ae894cb0b00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.601382 17661 tablet_service.cc:1467] Processing CreateTablet for tablet b0dd68775f514b6b983f28fd87d9e4ec (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240503 08:12:50.603576 17660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14598a4f2af1413b835d50517b27f305. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.602497 17662 tablet_service.cc:1467] Processing CreateTablet for tablet 39f868a4bdfb403fa462b79cc5507546 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240503 08:12:50.605654 17659 tablet_service.cc:1467] Processing CreateTablet for tablet 761ee807456f4691bb8ae39350bff31c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240503 08:12:50.610131 17661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0dd68775f514b6b983f28fd87d9e4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.610642 17664 tablet_service.cc:1467] Processing CreateTablet for tablet 2ee11da8ed904a74b46369a40ba83af8 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240503 08:12:50.610906 17663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2057a35eb684e41bac23078e6526b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.612363 17594 tablet_service.cc:1467] Processing CreateTablet for tablet fd9674d047e34552a9142e4df2147730 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240503 08:12:50.613641 17662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39f868a4bdfb403fa462b79cc5507546. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.613873 17594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd9674d047e34552a9142e4df2147730. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.614238 17664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ee11da8ed904a74b46369a40ba83af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.617519 17659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 761ee807456f4691bb8ae39350bff31c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.627067 17719 tablet_bootstrap.cc:492] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:50.627235 17719 ts_tablet_manager.cc:1367] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.066s user 0.028s sys 0.019s
I20240503 08:12:50.631785 17516 tablet_service.cc:1467] Processing CreateTablet for tablet cf0faa2ea34146b48c0842a7878e20f3 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240503 08:12:50.632196 17516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0faa2ea34146b48c0842a7878e20f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.640314 17719 raft_consensus.cc:348] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:50.640538 17719 raft_consensus.cc:374] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:50.640600 17719 raft_consensus.cc:729] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:50.642035 17718 tablet_bootstrap.cc:492] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:50.642951 17718 ts_tablet_manager.cc:1367] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.124s user 0.025s sys 0.050s
I20240503 08:12:50.640792 17719 consensus_queue.cc:260] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:50.668485 17718 raft_consensus.cc:348] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:50.668782 17718 raft_consensus.cc:374] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:50.668879 17718 raft_consensus.cc:729] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:50.672673 17591 tablet_service.cc:1467] Processing CreateTablet for tablet 4d14d9f86bea4e43a160d30bed9a6a30 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240503 08:12:50.674975 17512 tablet_service.cc:1467] Processing CreateTablet for tablet fd9674d047e34552a9142e4df2147730 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240503 08:12:50.669106 17718 consensus_queue.cc:260] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:50.677292 17591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d14d9f86bea4e43a160d30bed9a6a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.677543 17629 heartbeater.cc:503] Master 127.16.10.126:46597 was elected leader, sending a full tablet report...
I20240503 08:12:50.678133 17719 ts_tablet_manager.cc:1398] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.049s user 0.007s sys 0.012s
I20240503 08:12:50.678380 17668 tablet_service.cc:1467] Processing CreateTablet for tablet 519eb7f46c59460ba3b4a5613ff54894 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240503 08:12:50.678748 17668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 519eb7f46c59460ba3b4a5613ff54894. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.681406 17512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd9674d047e34552a9142e4df2147730. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.684306 17515 tablet_service.cc:1467] Processing CreateTablet for tablet 4d14d9f86bea4e43a160d30bed9a6a30 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240503 08:12:50.688287 17515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d14d9f86bea4e43a160d30bed9a6a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.690002 17719 tablet_bootstrap.cc:492] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:50.691023 17722 tablet_bootstrap.cc:492] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:50.700793 17585 tablet_service.cc:1467] Processing CreateTablet for tablet 8d90423110fd4c65af6911bc983a9d57 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240503 08:12:50.702998 17589 tablet_service.cc:1467] Processing CreateTablet for tablet 948437c8a338413c9b744147f6a8a5bd (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240503 08:12:50.704540 17588 tablet_service.cc:1467] Processing CreateTablet for tablet d620ba8c8c684a73af18b9fb62ea6113 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240503 08:12:50.707104 17585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d90423110fd4c65af6911bc983a9d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.707581 17586 tablet_service.cc:1467] Processing CreateTablet for tablet c48f27bec58e44308b20007f7ae59c82 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240503 08:12:50.707608 17513 tablet_service.cc:1467] Processing CreateTablet for tablet d620ba8c8c684a73af18b9fb62ea6113 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240503 08:12:50.708665 17589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 948437c8a338413c9b744147f6a8a5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.711673 17513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d620ba8c8c684a73af18b9fb62ea6113. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.712667 17586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c48f27bec58e44308b20007f7ae59c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.714171 17588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d620ba8c8c684a73af18b9fb62ea6113. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.714835 17718 ts_tablet_manager.cc:1398] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.072s user 0.010s sys 0.024s
I20240503 08:12:50.715090 17554 heartbeater.cc:503] Master 127.16.10.126:46597 was elected leader, sending a full tablet report...
I20240503 08:12:50.715144 17718 tablet_bootstrap.cc:492] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:50.722134 17722 tablet_bootstrap.cc:654] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:50.727867 17514 tablet_service.cc:1467] Processing CreateTablet for tablet 8d90423110fd4c65af6911bc983a9d57 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240503 08:12:50.736863 17667 tablet_service.cc:1467] Processing CreateTablet for tablet b5726229454f477d8e526198ede45aab (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240503 08:12:50.737412 17514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d90423110fd4c65af6911bc983a9d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.741986 17593 tablet_service.cc:1467] Processing CreateTablet for tablet abd9d58bdf05436195bd0afcca4c00d3 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240503 08:12:50.744967 17667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5726229454f477d8e526198ede45aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.746858 17590 tablet_service.cc:1467] Processing CreateTablet for tablet e346620585b34fafac5e29522169927a (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240503 08:12:50.747236 17519 tablet_service.cc:1467] Processing CreateTablet for tablet 948437c8a338413c9b744147f6a8a5bd (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240503 08:12:50.747737 17519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 948437c8a338413c9b744147f6a8a5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.748423 17593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abd9d58bdf05436195bd0afcca4c00d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.749956 17517 tablet_service.cc:1467] Processing CreateTablet for tablet abd9d58bdf05436195bd0afcca4c00d3 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240503 08:12:50.749924 17516 tablet_service.cc:1467] Processing CreateTablet for tablet c48f27bec58e44308b20007f7ae59c82 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240503 08:12:50.750344 17516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c48f27bec58e44308b20007f7ae59c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.750407 17724 raft_consensus.cc:482] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:50.752122 17590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e346620585b34fafac5e29522169927a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.752168 17661 tablet_service.cc:1467] Processing CreateTablet for tablet aee53c998fb44359b24cb8bf1e9ae658 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240503 08:12:50.752552 17661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee53c998fb44359b24cb8bf1e9ae658. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.757769 17517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abd9d58bdf05436195bd0afcca4c00d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.763504 17518 tablet_service.cc:1467] Processing CreateTablet for tablet e346620585b34fafac5e29522169927a (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240503 08:12:50.769079 17665 tablet_service.cc:1467] Processing CreateTablet for tablet 675688b228f147f8a88e69f43b91ef0c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240503 08:12:50.769594 17665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 675688b228f147f8a88e69f43b91ef0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.750556 17724 raft_consensus.cc:504] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:50.772225 17518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e346620585b34fafac5e29522169927a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.772382 17663 tablet_service.cc:1467] Processing CreateTablet for tablet db0fbf6819374978ab404bbfde4b9d42 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240503 08:12:50.777298 17663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db0fbf6819374978ab404bbfde4b9d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.777623 17719 tablet_bootstrap.cc:654] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:50.779237 17511 tablet_service.cc:1467] Processing CreateTablet for tablet 930776b028d34183b0aee54f1cc5d98d (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240503 08:12:50.783350 17592 tablet_service.cc:1467] Processing CreateTablet for tablet d7bdb7ab18e84803ae008edf16ca9d4f (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240503 08:12:50.783998 17511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 930776b028d34183b0aee54f1cc5d98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.784956 17594 tablet_service.cc:1467] Processing CreateTablet for tablet 930776b028d34183b0aee54f1cc5d98d (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240503 08:12:50.785283 17664 tablet_service.cc:1467] Processing CreateTablet for tablet 01c1231eca744af282822464f9af362e (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240503 08:12:50.786720 17510 tablet_service.cc:1467] Processing CreateTablet for tablet d7bdb7ab18e84803ae008edf16ca9d4f (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240503 08:12:50.789364 17592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7bdb7ab18e84803ae008edf16ca9d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.790491 17594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 930776b028d34183b0aee54f1cc5d98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.790560 17724 leader_election.cc:288] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:50.790810 17510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7bdb7ab18e84803ae008edf16ca9d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.790915 17659 tablet_service.cc:1467] Processing CreateTablet for tablet dc6b261ca02d4cfe89b131c0ad46c8d2 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240503 08:12:50.791280 17587 tablet_service.cc:1467] Processing CreateTablet for tablet a2f9b49da78f44acb5a4f554eef1ead7 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240503 08:12:50.792259 17664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01c1231eca744af282822464f9af362e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.792835 17659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc6b261ca02d4cfe89b131c0ad46c8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.793248 17722 tablet_bootstrap.cc:492] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:50.793422 17722 ts_tablet_manager.cc:1367] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.110s user 0.017s sys 0.024s
I20240503 08:12:50.794710 17666 tablet_service.cc:1467] Processing CreateTablet for tablet 979822ec7a3842248c37ee6ec6bf618c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240503 08:12:50.802526 17660 tablet_service.cc:1467] Processing CreateTablet for tablet 5f95209235434aa0aa22bb6fff89bbb5 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240503 08:12:50.803718 17587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2f9b49da78f44acb5a4f554eef1ead7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.805371 17666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 979822ec7a3842248c37ee6ec6bf618c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.806766 17662 tablet_service.cc:1467] Processing CreateTablet for tablet f131aca1d2274b0ba4df3499cd835616 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240503 08:12:50.806809 17586 tablet_service.cc:1467] Processing CreateTablet for tablet aa285ca958654cc28c88c4844a78418e (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240503 08:12:50.808478 17718 tablet_bootstrap.cc:654] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:50.809284 17660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f95209235434aa0aa22bb6fff89bbb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.814641 17586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa285ca958654cc28c88c4844a78418e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.815132 17662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f131aca1d2274b0ba4df3499cd835616. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.825371 17722 raft_consensus.cc:348] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } }
I20240503 08:12:50.826761 17668 tablet_service.cc:1467] Processing CreateTablet for tablet 4afbd55d9ebb4908adb04063270ddcba (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240503 08:12:50.828119 17722 raft_consensus.cc:374] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:50.828331 17668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4afbd55d9ebb4908adb04063270ddcba. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.830157 17722 raft_consensus.cc:729] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:50.837839 17722 consensus_queue.cc:260] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } }
I20240503 08:12:50.847694 17519 tablet_service.cc:1467] Processing CreateTablet for tablet a2f9b49da78f44acb5a4f554eef1ead7 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240503 08:12:50.850782 17664 tablet_service.cc:1467] Processing CreateTablet for tablet cf0faa2ea34146b48c0842a7878e20f3 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20240503 08:12:50.851284 17555 tablet.cc:2369] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240503 08:12:50.856556 17519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2f9b49da78f44acb5a4f554eef1ead7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.857462 17664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0faa2ea34146b48c0842a7878e20f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.863796 17588 tablet_service.cc:1467] Processing CreateTablet for tablet 5167aa62b10d4ad0a97d5388247ee1be (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240503 08:12:50.864303 17588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5167aa62b10d4ad0a97d5388247ee1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.865128 17513 tablet_service.cc:1467] Processing CreateTablet for tablet aa285ca958654cc28c88c4844a78418e (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240503 08:12:50.865556 17513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa285ca958654cc28c88c4844a78418e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.882624 17515 tablet_service.cc:1467] Processing CreateTablet for tablet 5167aa62b10d4ad0a97d5388247ee1be (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240503 08:12:50.883200 17591 tablet_service.cc:1467] Processing CreateTablet for tablet 56d3f2aacab848e2a887d16316b77932 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240503 08:12:50.884579 17514 tablet_service.cc:1467] Processing CreateTablet for tablet 56d3f2aacab848e2a887d16316b77932 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240503 08:12:50.887336 17591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56d3f2aacab848e2a887d16316b77932. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.890255 17514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56d3f2aacab848e2a887d16316b77932. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.888760 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf8db1fd73474fe2ad968e53f0ab71ae" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:50.891391 17495 leader_election.cc:341] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:50.892763 17661 tablet_service.cc:1467] Processing CreateTablet for tablet fd9674d047e34552a9142e4df2147730 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240503 08:12:50.893069 17661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd9674d047e34552a9142e4df2147730. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.894409 17703 heartbeater.cc:503] Master 127.16.10.126:46597 was elected leader, sending a full tablet report...
I20240503 08:12:50.895802 17722 ts_tablet_manager.cc:1398] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.092s user 0.014s sys 0.025s
I20240503 08:12:50.896359 17515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5167aa62b10d4ad0a97d5388247ee1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.906828 17589 tablet_service.cc:1467] Processing CreateTablet for tablet 0cb36da26ec14e20bb9bb27ba7054e1e (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240503 08:12:50.907232 17589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cb36da26ec14e20bb9bb27ba7054e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.908334 17722 tablet_bootstrap.cc:492] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:50.908586 17512 tablet_service.cc:1467] Processing CreateTablet for tablet 0cb36da26ec14e20bb9bb27ba7054e1e (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240503 08:12:50.909072 17512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cb36da26ec14e20bb9bb27ba7054e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.910708 17585 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba8912ee43645eda5d975fe5d584d91 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240503 08:12:50.911047 17585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba8912ee43645eda5d975fe5d584d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.917820 17719 tablet_bootstrap.cc:492] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:50.917981 17719 ts_tablet_manager.cc:1367] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.240s user 0.023s sys 0.027s
I20240503 08:12:50.918123 17718 tablet_bootstrap.cc:492] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:50.918233 17718 ts_tablet_manager.cc:1367] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.203s user 0.015s sys 0.011s
I20240503 08:12:50.921931 17722 tablet_bootstrap.cc:654] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:50.922274 17587 tablet_service.cc:1467] Processing CreateTablet for tablet 70e5b64ee81948b0a2ed2bbb648730bf (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240503 08:12:50.922650 17587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e5b64ee81948b0a2ed2bbb648730bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.922564 17665 tablet_service.cc:1467] Processing CreateTablet for tablet 4d14d9f86bea4e43a160d30bed9a6a30 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240503 08:12:50.922928 17665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d14d9f86bea4e43a160d30bed9a6a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.923806 17594 tablet_service.cc:1467] Processing CreateTablet for tablet 2afd3767b7ef41368dfd9f684ad4ce46 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240503 08:12:50.924185 17594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2afd3767b7ef41368dfd9f684ad4ce46. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.927867 17663 tablet_service.cc:1467] Processing CreateTablet for tablet d620ba8c8c684a73af18b9fb62ea6113 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240503 08:12:50.928164 17663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d620ba8c8c684a73af18b9fb62ea6113. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.929863 17667 tablet_service.cc:1467] Processing CreateTablet for tablet 8d90423110fd4c65af6911bc983a9d57 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240503 08:12:50.930222 17667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d90423110fd4c65af6911bc983a9d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.932840 17592 tablet_service.cc:1467] Processing CreateTablet for tablet 69e170a0107040ce87405dd80cfce759 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240503 08:12:50.933161 17592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69e170a0107040ce87405dd80cfce759. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.933974 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf8db1fd73474fe2ad968e53f0ab71ae" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:50.934019 17718 raft_consensus.cc:348] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:50.934176 17718 raft_consensus.cc:374] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:50.934224 17718 raft_consensus.cc:729] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:50.934404 17718 consensus_queue.cc:260] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:50.935981 17662 tablet_service.cc:1467] Processing CreateTablet for tablet 948437c8a338413c9b744147f6a8a5bd (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240503 08:12:50.936823 17593 tablet_service.cc:1467] Processing CreateTablet for tablet b54091717ba2493b813cc7dcc1ba1e7b (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240503 08:12:50.937117 17593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b54091717ba2493b813cc7dcc1ba1e7b. 1 dirs total, 0 dirs full, 0 dirs failed
W20240503 08:12:50.935249 17493 leader_election.cc:341] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:50.938328 17493 leader_election.cc:302] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:50.938490 17590 tablet_service.cc:1467] Processing CreateTablet for tablet 06c8a838b19a469ea44e7050f78bf375 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240503 08:12:50.938788 17590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06c8a838b19a469ea44e7050f78bf375. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.939263 17666 tablet_service.cc:1467] Processing CreateTablet for tablet c48f27bec58e44308b20007f7ae59c82 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240503 08:12:50.939574 17666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c48f27bec58e44308b20007f7ae59c82. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.940274 17662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 948437c8a338413c9b744147f6a8a5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.941517 17724 raft_consensus.cc:2726] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:50.941843 17516 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba8912ee43645eda5d975fe5d584d91 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240503 08:12:50.945832 17718 ts_tablet_manager.cc:1398] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20240503 08:12:50.949534 17668 tablet_service.cc:1467] Processing CreateTablet for tablet abd9d58bdf05436195bd0afcca4c00d3 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240503 08:12:50.949862 17668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abd9d58bdf05436195bd0afcca4c00d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.953047 17511 tablet_service.cc:1467] Processing CreateTablet for tablet 06c8a838b19a469ea44e7050f78bf375 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240503 08:12:50.953253 17587 tablet_service.cc:1467] Processing CreateTablet for tablet bde42387397a459b9231991cc3f6b149 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240503 08:12:50.953608 17587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bde42387397a459b9231991cc3f6b149. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.955881 17510 tablet_service.cc:1467] Processing CreateTablet for tablet 70e5b64ee81948b0a2ed2bbb648730bf (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240503 08:12:50.956823 17591 tablet_service.cc:1467] Processing CreateTablet for tablet ecc9aa5d797f429d835a9c5e8372fd4e (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240503 08:12:50.957152 17591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecc9aa5d797f429d835a9c5e8372fd4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.955003 17719 raft_consensus.cc:348] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:50.960477 17660 tablet_service.cc:1467] Processing CreateTablet for tablet e346620585b34fafac5e29522169927a (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240503 08:12:50.961086 17719 raft_consensus.cc:374] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:50.961216 17719 raft_consensus.cc:729] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:50.961512 17719 consensus_queue.cc:260] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:50.960717 17664 tablet_service.cc:1467] Processing CreateTablet for tablet 930776b028d34183b0aee54f1cc5d98d (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240503 08:12:50.962082 17664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 930776b028d34183b0aee54f1cc5d98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.963639 17516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba8912ee43645eda5d975fe5d584d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.964715 17517 tablet_service.cc:1467] Processing CreateTablet for tablet 69e170a0107040ce87405dd80cfce759 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240503 08:12:50.965193 17513 tablet_service.cc:1467] Processing CreateTablet for tablet b54091717ba2493b813cc7dcc1ba1e7b (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240503 08:12:50.966387 17517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69e170a0107040ce87405dd80cfce759. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.966430 17519 tablet_service.cc:1467] Processing CreateTablet for tablet 2afd3767b7ef41368dfd9f684ad4ce46 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240503 08:12:50.966694 17510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e5b64ee81948b0a2ed2bbb648730bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.966971 17660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e346620585b34fafac5e29522169927a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.967258 17511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06c8a838b19a469ea44e7050f78bf375. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.965627 17718 tablet_bootstrap.cc:492] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:50.965248 17659 tablet_service.cc:1467] Processing CreateTablet for tablet d7bdb7ab18e84803ae008edf16ca9d4f (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240503 08:12:50.967933 17659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7bdb7ab18e84803ae008edf16ca9d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.967639 17513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b54091717ba2493b813cc7dcc1ba1e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.968776 17592 tablet_service.cc:1467] Processing CreateTablet for tablet a7102ed1b82548e1a30be22c6a9f28af (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240503 08:12:50.969054 17592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7102ed1b82548e1a30be22c6a9f28af. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.969813 17589 tablet_service.cc:1467] Processing CreateTablet for tablet aa4e39d8646445ac80703d1a84bd1824 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240503 08:12:50.970170 17519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2afd3767b7ef41368dfd9f684ad4ce46. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.970228 17518 tablet_service.cc:1467] Processing CreateTablet for tablet bde42387397a459b9231991cc3f6b149 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240503 08:12:50.970532 17518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bde42387397a459b9231991cc3f6b149. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.971271 17588 tablet_service.cc:1467] Processing CreateTablet for tablet bbcdd1b33ca34becb52d034d7b9f3dcd (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240503 08:12:50.971606 17588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbcdd1b33ca34becb52d034d7b9f3dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.975244 17589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa4e39d8646445ac80703d1a84bd1824. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.978078 17586 tablet_service.cc:1467] Processing CreateTablet for tablet fe04116f0cd342ec93e07e3dedeff5f5 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240503 08:12:50.978542 17586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe04116f0cd342ec93e07e3dedeff5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.979851 17661 tablet_service.cc:1467] Processing CreateTablet for tablet a2f9b49da78f44acb5a4f554eef1ead7 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240503 08:12:50.980384 17661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2f9b49da78f44acb5a4f554eef1ead7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.982606 17719 ts_tablet_manager.cc:1398] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.065s user 0.001s sys 0.001s
I20240503 08:12:50.982913 17719 tablet_bootstrap.cc:492] T cf8db1fd73474fe2ad968e53f0ab71ae P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:50.988584 17514 tablet_service.cc:1467] Processing CreateTablet for tablet ecc9aa5d797f429d835a9c5e8372fd4e (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240503 08:12:50.988924 17514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecc9aa5d797f429d835a9c5e8372fd4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:50.993052 17719 tablet_bootstrap.cc:654] T cf8db1fd73474fe2ad968e53f0ab71ae P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:50.993822 17722 tablet_bootstrap.cc:492] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:50.993958 17722 ts_tablet_manager.cc:1367] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.098s user 0.021s sys 0.006s
I20240503 08:12:50.994311 17718 tablet_bootstrap.cc:654] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:50.995602 17722 raft_consensus.cc:348] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:50.995796 17722 raft_consensus.cc:374] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:50.995855 17722 raft_consensus.cc:729] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:50.996119 17722 consensus_queue.cc:260] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.003849 17593 tablet_service.cc:1467] Processing CreateTablet for tablet 8d8c3f774ca34e288cfa916b288ec116 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240503 08:12:51.004299 17593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d8c3f774ca34e288cfa916b288ec116. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.005218 17722 ts_tablet_manager.cc:1398] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20240503 08:12:51.006184 17722 tablet_bootstrap.cc:492] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.007763 17722 tablet_bootstrap.cc:654] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.008128 17668 tablet_service.cc:1467] Processing CreateTablet for tablet aa285ca958654cc28c88c4844a78418e (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240503 08:12:51.008531 17668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa285ca958654cc28c88c4844a78418e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.014145 17512 tablet_service.cc:1467] Processing CreateTablet for tablet a7102ed1b82548e1a30be22c6a9f28af (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240503 08:12:51.014564 17512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7102ed1b82548e1a30be22c6a9f28af. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.017403 17667 tablet_service.cc:1467] Processing CreateTablet for tablet 56d3f2aacab848e2a887d16316b77932 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240503 08:12:51.017827 17667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56d3f2aacab848e2a887d16316b77932. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.023993 17585 tablet_service.cc:1467] Processing CreateTablet for tablet b83d1e0f957d43528b01dbf1b7fa6d2c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240503 08:12:51.024459 17585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b83d1e0f957d43528b01dbf1b7fa6d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.030943 17586 tablet_service.cc:1467] Processing CreateTablet for tablet 686d4823ccb6499e902d6d4bb3284b05 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240503 08:12:51.032756 17590 tablet_service.cc:1467] Processing CreateTablet for tablet f833d72baefb4603bca6c4550cc03596 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240503 08:12:51.035569 17666 tablet_service.cc:1467] Processing CreateTablet for tablet 0cb36da26ec14e20bb9bb27ba7054e1e (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240503 08:12:51.036073 17666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cb36da26ec14e20bb9bb27ba7054e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.039767 17663 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba8912ee43645eda5d975fe5d584d91 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240503 08:12:51.040266 17663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba8912ee43645eda5d975fe5d584d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.049669 17515 tablet_service.cc:1467] Processing CreateTablet for tablet aa4e39d8646445ac80703d1a84bd1824 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240503 08:12:51.050144 17515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa4e39d8646445ac80703d1a84bd1824. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.053637 17665 tablet_service.cc:1467] Processing CreateTablet for tablet 06c8a838b19a469ea44e7050f78bf375 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240503 08:12:51.054049 17665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06c8a838b19a469ea44e7050f78bf375. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.054442 17519 tablet_service.cc:1467] Processing CreateTablet for tablet bbcdd1b33ca34becb52d034d7b9f3dcd (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240503 08:12:51.054811 17519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbcdd1b33ca34becb52d034d7b9f3dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.057616 17718 tablet_bootstrap.cc:492] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.057757 17718 ts_tablet_manager.cc:1367] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.092s user 0.026s sys 0.035s
I20240503 08:12:51.058467 17718 raft_consensus.cc:348] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.058634 17718 raft_consensus.cc:374] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.058689 17718 raft_consensus.cc:729] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.058902 17718 consensus_queue.cc:260] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.059309 17592 tablet_service.cc:1467] Processing CreateTablet for tablet 4639818fe3664df29f4f555689f5d05d (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240503 08:12:51.059563 17718 ts_tablet_manager.cc:1398] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.059811 17718 tablet_bootstrap.cc:492] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.060032 17588 tablet_service.cc:1467] Processing CreateTablet for tablet 601ae23f610f4f67acbbc876319b1ce5 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240503 08:12:51.061268 17718 tablet_bootstrap.cc:654] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.061182 17514 tablet_service.cc:1467] Processing CreateTablet for tablet 8d8c3f774ca34e288cfa916b288ec116 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240503 08:12:51.061537 17514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d8c3f774ca34e288cfa916b288ec116. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.066784 17515 tablet_service.cc:1467] Processing CreateTablet for tablet b83d1e0f957d43528b01dbf1b7fa6d2c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240503 08:12:51.069491 17662 tablet_service.cc:1467] Processing CreateTablet for tablet 70e5b64ee81948b0a2ed2bbb648730bf (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240503 08:12:51.061182 17513 tablet_service.cc:1467] Processing CreateTablet for tablet fe04116f0cd342ec93e07e3dedeff5f5 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240503 08:12:51.079770 17662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e5b64ee81948b0a2ed2bbb648730bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.069979 17661 tablet_service.cc:1467] Processing CreateTablet for tablet 2afd3767b7ef41368dfd9f684ad4ce46 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240503 08:12:51.070492 17594 tablet_service.cc:1467] Processing CreateTablet for tablet 7232c68b68b8434ea816445c62b9dcc7 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240503 08:12:51.070910 17660 tablet_service.cc:1467] Processing CreateTablet for tablet b54091717ba2493b813cc7dcc1ba1e7b (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240503 08:12:51.072134 17587 tablet_service.cc:1467] Processing CreateTablet for tablet f38b04ed0f584c4f8246b218b3f76dfb (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240503 08:12:51.073515 17510 tablet_service.cc:1467] Processing CreateTablet for tablet 686d4823ccb6499e902d6d4bb3284b05 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240503 08:12:51.079770 17513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe04116f0cd342ec93e07e3dedeff5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.080675 17660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b54091717ba2493b813cc7dcc1ba1e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.074976 17516 tablet_service.cc:1467] Processing CreateTablet for tablet f833d72baefb4603bca6c4550cc03596 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240503 08:12:51.081426 17510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 686d4823ccb6499e902d6d4bb3284b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.081548 17661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2afd3767b7ef41368dfd9f684ad4ce46. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.081823 17516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f833d72baefb4603bca6c4550cc03596. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.076561 17512 tablet_service.cc:1467] Processing CreateTablet for tablet 4639818fe3664df29f4f555689f5d05d (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240503 08:12:51.076968 17511 tablet_service.cc:1467] Processing CreateTablet for tablet 601ae23f610f4f67acbbc876319b1ce5 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240503 08:12:51.077384 17593 tablet_service.cc:1467] Processing CreateTablet for tablet 387c7945cff64b3fa22f7a94b1b301f8 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240503 08:12:51.082161 17515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b83d1e0f957d43528b01dbf1b7fa6d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.082540 17517 tablet_service.cc:1467] Processing CreateTablet for tablet 7232c68b68b8434ea816445c62b9dcc7 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240503 08:12:51.083438 17517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7232c68b68b8434ea816445c62b9dcc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.087533 17664 tablet_service.cc:1467] Processing CreateTablet for tablet 5167aa62b10d4ad0a97d5388247ee1be (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240503 08:12:51.087941 17664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5167aa62b10d4ad0a97d5388247ee1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.088176 17511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 601ae23f610f4f67acbbc876319b1ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.089957 17518 tablet_service.cc:1467] Processing CreateTablet for tablet f38b04ed0f584c4f8246b218b3f76dfb (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240503 08:12:51.090319 17518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f38b04ed0f584c4f8246b218b3f76dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.092608 17589 tablet_service.cc:1467] Processing CreateTablet for tablet 6fac613df5c94dec8836c5bb2cb59445 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240503 08:12:51.095655 17659 tablet_service.cc:1467] Processing CreateTablet for tablet 69e170a0107040ce87405dd80cfce759 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240503 08:12:51.096316 17659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69e170a0107040ce87405dd80cfce759. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.098780 17586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 686d4823ccb6499e902d6d4bb3284b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.099021 17587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f38b04ed0f584c4f8246b218b3f76dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.099206 17589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fac613df5c94dec8836c5bb2cb59445. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.099552 17592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4639818fe3664df29f4f555689f5d05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.100908 17594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7232c68b68b8434ea816445c62b9dcc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.101262 17590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f833d72baefb4603bca6c4550cc03596. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.101531 17593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 387c7945cff64b3fa22f7a94b1b301f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.103165 17588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 601ae23f610f4f67acbbc876319b1ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.105173 17512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4639818fe3664df29f4f555689f5d05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.106989 17514 tablet_service.cc:1467] Processing CreateTablet for tablet 387c7945cff64b3fa22f7a94b1b301f8 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240503 08:12:51.107759 17729 raft_consensus.cc:482] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.110453 17514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 387c7945cff64b3fa22f7a94b1b301f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.107889 17729 raft_consensus.cc:504] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.111066 17519 tablet_service.cc:1467] Processing CreateTablet for tablet 6fac613df5c94dec8836c5bb2cb59445 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240503 08:12:51.112710 17519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fac613df5c94dec8836c5bb2cb59445. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.113737 17662 tablet_service.cc:1467] Processing CreateTablet for tablet bde42387397a459b9231991cc3f6b149 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240503 08:12:51.114113 17662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bde42387397a459b9231991cc3f6b149. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.115623 17719 tablet_bootstrap.cc:492] T cf8db1fd73474fe2ad968e53f0ab71ae P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.115764 17719 ts_tablet_manager.cc:1367] T cf8db1fd73474fe2ad968e53f0ab71ae P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.133s user 0.010s sys 0.000s
I20240503 08:12:51.119837 17729 leader_election.cc:288] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.123534 17666 tablet_service.cc:1467] Processing CreateTablet for tablet a7102ed1b82548e1a30be22c6a9f28af (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240503 08:12:51.123947 17666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7102ed1b82548e1a30be22c6a9f28af. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.132278 17668 tablet_service.cc:1467] Processing CreateTablet for tablet ecc9aa5d797f429d835a9c5e8372fd4e (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240503 08:12:51.134446 17667 tablet_service.cc:1467] Processing CreateTablet for tablet aa4e39d8646445ac80703d1a84bd1824 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240503 08:12:51.135143 17668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecc9aa5d797f429d835a9c5e8372fd4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.135759 17723 raft_consensus.cc:482] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.142057 17667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa4e39d8646445ac80703d1a84bd1824. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.143122 17724 raft_consensus.cc:482] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.143263 17724 raft_consensus.cc:504] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.149474 17724 leader_election.cc:288] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.150121 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e5a4235b0d0427cb308ae894cb0b00a" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
W20240503 08:12:51.150655 17493 leader_election.cc:341] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.135886 17723 raft_consensus.cc:504] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.154615 17723 leader_election.cc:288] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.166245 17719 raft_consensus.cc:348] T cf8db1fd73474fe2ad968e53f0ab71ae P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.166505 17719 raft_consensus.cc:374] T cf8db1fd73474fe2ad968e53f0ab71ae P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.166566 17719 raft_consensus.cc:729] T cf8db1fd73474fe2ad968e53f0ab71ae P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.167835 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e5a4235b0d0427cb308ae894cb0b00a" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.170449 17719 consensus_queue.cc:260] T cf8db1fd73474fe2ad968e53f0ab71ae P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.177407 17718 tablet_bootstrap.cc:492] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.177575 17718 ts_tablet_manager.cc:1367] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.118s user 0.057s sys 0.042s
I20240503 08:12:51.184806 17722 tablet_bootstrap.cc:492] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.184976 17722 ts_tablet_manager.cc:1367] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.179s user 0.051s sys 0.043s
I20240503 08:12:51.189638 17663 tablet_service.cc:1467] Processing CreateTablet for tablet bbcdd1b33ca34becb52d034d7b9f3dcd (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240503 08:12:51.190116 17663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbcdd1b33ca34becb52d034d7b9f3dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.204598 17718 raft_consensus.cc:348] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } }
I20240503 08:12:51.204768 17718 raft_consensus.cc:374] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.204825 17718 raft_consensus.cc:729] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.204981 17718 consensus_queue.cc:260] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } }
I20240503 08:12:51.209658 17665 tablet_service.cc:1467] Processing CreateTablet for tablet 8d8c3f774ca34e288cfa916b288ec116 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240503 08:12:51.210022 17665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d8c3f774ca34e288cfa916b288ec116. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.210852 17718 ts_tablet_manager.cc:1398] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.033s user 0.001s sys 0.001s
I20240503 08:12:51.211181 17718 tablet_bootstrap.cc:492] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.207758 17664 tablet_service.cc:1467] Processing CreateTablet for tablet fe04116f0cd342ec93e07e3dedeff5f5 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240503 08:12:51.216671 17664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe04116f0cd342ec93e07e3dedeff5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.216812 17723 raft_consensus.cc:482] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.216930 17723 raft_consensus.cc:504] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.217370 17722 raft_consensus.cc:348] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.217506 17722 raft_consensus.cc:374] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.217551 17722 raft_consensus.cc:729] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.217808 17723 leader_election.cc:288] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.217726 17722 consensus_queue.cc:260] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.212074 17661 tablet_service.cc:1467] Processing CreateTablet for tablet b83d1e0f957d43528b01dbf1b7fa6d2c (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240503 08:12:51.218911 17661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b83d1e0f957d43528b01dbf1b7fa6d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.222872 17722 ts_tablet_manager.cc:1398] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20240503 08:12:51.223201 17722 tablet_bootstrap.cc:492] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
W20240503 08:12:51.243011 17495 leader_election.cc:341] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.243175 17495 leader_election.cc:302] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.243425 17724 raft_consensus.cc:2726] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.244490 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14377788ca9f4bb4af727da959857d9c" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
W20240503 08:12:51.244966 17568 leader_election.cc:341] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.245697 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2057a35eb684e41bac23078e6526b08" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.246111 17660 tablet_service.cc:1467] Processing CreateTablet for tablet 686d4823ccb6499e902d6d4bb3284b05 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240503 08:12:51.246224 17659 tablet_service.cc:1467] Processing CreateTablet for tablet f833d72baefb4603bca6c4550cc03596 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240503 08:12:51.246467 17660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 686d4823ccb6499e902d6d4bb3284b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.246647 17659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f833d72baefb4603bca6c4550cc03596. 1 dirs total, 0 dirs full, 0 dirs failed
W20240503 08:12:51.247476 17568 leader_election.cc:341] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.249657 17666 tablet_service.cc:1467] Processing CreateTablet for tablet 4639818fe3664df29f4f555689f5d05d (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240503 08:12:51.249951 17666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4639818fe3664df29f4f555689f5d05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.251375 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf8db1fd73474fe2ad968e53f0ab71ae" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.253243 17718 tablet_bootstrap.cc:654] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.255895 17529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf8db1fd73474fe2ad968e53f0ab71ae" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.256137 17529 raft_consensus.cc:2454] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.256246 17667 tablet_service.cc:1467] Processing CreateTablet for tablet 601ae23f610f4f67acbbc876319b1ce5 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240503 08:12:51.256526 17641 leader_election.cc:302] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.256628 17667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 601ae23f610f4f67acbbc876319b1ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.256774 17729 raft_consensus.cc:2781] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.256851 17729 raft_consensus.cc:482] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.256906 17729 raft_consensus.cc:3037] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.264295 17722 tablet_bootstrap.cc:654] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.265027 17668 tablet_service.cc:1467] Processing CreateTablet for tablet 7232c68b68b8434ea816445c62b9dcc7 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240503 08:12:51.265463 17668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7232c68b68b8434ea816445c62b9dcc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.268667 17729 raft_consensus.cc:504] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.269346 17729 leader_election.cc:288] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.269938 17529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf8db1fd73474fe2ad968e53f0ab71ae" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.270112 17529 raft_consensus.cc:3037] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.273171 17722 tablet_bootstrap.cc:492] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.273301 17722 ts_tablet_manager.cc:1367] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.000s
I20240503 08:12:51.270900 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf8db1fd73474fe2ad968e53f0ab71ae" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.277787 17604 raft_consensus.cc:2454] T cf8db1fd73474fe2ad968e53f0ab71ae P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.278780 17719 ts_tablet_manager.cc:1398] T cf8db1fd73474fe2ad968e53f0ab71ae P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.163s user 0.014s sys 0.000s
I20240503 08:12:51.279093 17719 tablet_bootstrap.cc:492] T b0dd68775f514b6b983f28fd87d9e4ec P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.280664 17664 tablet_service.cc:1467] Processing CreateTablet for tablet f38b04ed0f584c4f8246b218b3f76dfb (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240503 08:12:51.281044 17664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f38b04ed0f584c4f8246b218b3f76dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.282106 17529 raft_consensus.cc:2454] T cf8db1fd73474fe2ad968e53f0ab71ae P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
W20240503 08:12:51.282673 17475 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240503 08:12:51.284363 17529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14377788ca9f4bb4af727da959857d9c" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
W20240503 08:12:51.286154 17567 leader_election.cc:341] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.286263 17567 leader_election.cc:302] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2
I20240503 08:12:51.286638 17723 raft_consensus.cc:2726] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.283601 17641 leader_election.cc:302] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.289199 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2057a35eb684e41bac23078e6526b08" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
W20240503 08:12:51.289655 17567 leader_election.cc:341] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.289785 17729 raft_consensus.cc:2781] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.289768 17567 leader_election.cc:302] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2
I20240503 08:12:51.290284 17723 raft_consensus.cc:2726] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.288203 17663 tablet_service.cc:1467] Processing CreateTablet for tablet 387c7945cff64b3fa22f7a94b1b301f8 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240503 08:12:51.293361 17663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 387c7945cff64b3fa22f7a94b1b301f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.295634 17719 tablet_bootstrap.cc:654] T b0dd68775f514b6b983f28fd87d9e4ec P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.291872 17662 tablet_service.cc:1467] Processing CreateTablet for tablet 6fac613df5c94dec8836c5bb2cb59445 (DEFAULT_TABLE table=test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240503 08:12:51.301156 17662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fac613df5c94dec8836c5bb2cb59445. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:51.315140 17722 raft_consensus.cc:348] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.315389 17722 raft_consensus.cc:374] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.315465 17722 raft_consensus.cc:729] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.315675 17722 consensus_queue.cc:260] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.316072 17718 tablet_bootstrap.cc:492] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.316143 17729 raft_consensus.cc:686] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:51.316203 17718 ts_tablet_manager.cc:1367] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.105s user 0.015s sys 0.019s
I20240503 08:12:51.316419 17729 consensus_queue.cc:237] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.316839 17718 raft_consensus.cc:348] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.317030 17718 raft_consensus.cc:374] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.317097 17718 raft_consensus.cc:729] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.317337 17718 consensus_queue.cc:260] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.317852 17718 ts_tablet_manager.cc:1398] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.317447 17719 tablet_bootstrap.cc:492] T b0dd68775f514b6b983f28fd87d9e4ec P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.318328 17722 ts_tablet_manager.cc:1398] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.045s user 0.000s sys 0.004s
I20240503 08:12:51.318390 17718 tablet_bootstrap.cc:492] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.318553 17722 tablet_bootstrap.cc:492] T 14377788ca9f4bb4af727da959857d9c P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.318174 17719 ts_tablet_manager.cc:1367] T b0dd68775f514b6b983f28fd87d9e4ec P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.039s user 0.014s sys 0.003s
I20240503 08:12:51.320102 17718 tablet_bootstrap.cc:654] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.320035 17719 raft_consensus.cc:348] T b0dd68775f514b6b983f28fd87d9e4ec P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.320251 17719 raft_consensus.cc:374] T b0dd68775f514b6b983f28fd87d9e4ec P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.320348 17719 raft_consensus.cc:729] T b0dd68775f514b6b983f28fd87d9e4ec P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.320565 17719 consensus_queue.cc:260] T b0dd68775f514b6b983f28fd87d9e4ec P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.321800 17722 tablet_bootstrap.cc:654] T 14377788ca9f4bb4af727da959857d9c P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.321970 17719 ts_tablet_manager.cc:1398] T b0dd68775f514b6b983f28fd87d9e4ec P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.322609 17746 raft_consensus.cc:482] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.322713 17719 tablet_bootstrap.cc:492] T 5e5a4235b0d0427cb308ae894cb0b00a P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.322803 17746 raft_consensus.cc:504] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } }
I20240503 08:12:51.324049 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb6ec2d5ea544a3803f1f5e456901a3" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.324263 17528 raft_consensus.cc:2454] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.324651 17641 leader_election.cc:302] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.324877 17719 tablet_bootstrap.cc:654] T 5e5a4235b0d0427cb308ae894cb0b00a P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.324930 17744 raft_consensus.cc:2781] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.325034 17744 raft_consensus.cc:482] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.325114 17744 raft_consensus.cc:3037] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.327811 17744 raft_consensus.cc:504] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } }
I20240503 08:12:51.328253 17722 tablet_bootstrap.cc:492] T 14377788ca9f4bb4af727da959857d9c P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.328423 17722 ts_tablet_manager.cc:1367] T 14377788ca9f4bb4af727da959857d9c P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20240503 08:12:51.328678 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb6ec2d5ea544a3803f1f5e456901a3" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.328876 17528 raft_consensus.cc:3037] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.329653 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb6ec2d5ea544a3803f1f5e456901a3" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
W20240503 08:12:51.330070 17644 leader_election.cc:341] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.330269 17744 leader_election.cc:288] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.330821 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0eb6ec2d5ea544a3803f1f5e456901a3" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:51.331211 17644 leader_election.cc:341] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.331344 17746 leader_election.cc:288] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.331732 17528 raft_consensus.cc:2454] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.332172 17641 leader_election.cc:302] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.332437 17746 raft_consensus.cc:2781] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.332628 17746 raft_consensus.cc:686] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:51.332897 17746 consensus_queue.cc:237] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } }
I20240503 08:12:51.333132 17722 raft_consensus.cc:348] T 14377788ca9f4bb4af727da959857d9c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.333292 17722 raft_consensus.cc:374] T 14377788ca9f4bb4af727da959857d9c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.333352 17722 raft_consensus.cc:729] T 14377788ca9f4bb4af727da959857d9c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.334061 17722 consensus_queue.cc:260] T 14377788ca9f4bb4af727da959857d9c P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.334583 17722 ts_tablet_manager.cc:1398] T 14377788ca9f4bb4af727da959857d9c P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240503 08:12:51.334717 17719 tablet_bootstrap.cc:492] T 5e5a4235b0d0427cb308ae894cb0b00a P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.334862 17722 tablet_bootstrap.cc:492] T 2ee11da8ed904a74b46369a40ba83af8 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.334937 17719 ts_tablet_manager.cc:1367] T 5e5a4235b0d0427cb308ae894cb0b00a P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.005s
I20240503 08:12:51.335732 17719 raft_consensus.cc:348] T 5e5a4235b0d0427cb308ae894cb0b00a P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.335986 17719 raft_consensus.cc:374] T 5e5a4235b0d0427cb308ae894cb0b00a P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.336095 17719 raft_consensus.cc:729] T 5e5a4235b0d0427cb308ae894cb0b00a P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.336371 17719 consensus_queue.cc:260] T 5e5a4235b0d0427cb308ae894cb0b00a P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.336623 17722 tablet_bootstrap.cc:654] T 2ee11da8ed904a74b46369a40ba83af8 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.339478 17719 ts_tablet_manager.cc:1398] T 5e5a4235b0d0427cb308ae894cb0b00a P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:12:51.342123 17719 tablet_bootstrap.cc:492] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.341779 17426 catalog_manager.cc:5484] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:51.342907 17724 raft_consensus.cc:482] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.343026 17724 raft_consensus.cc:504] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.343734 17724 leader_election.cc:288] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.344133 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ee11da8ed904a74b46369a40ba83af8" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.344266 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ee11da8ed904a74b46369a40ba83af8" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
W20240503 08:12:51.344574 17495 leader_election.cc:341] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.344686 17722 tablet_bootstrap.cc:492] T 2ee11da8ed904a74b46369a40ba83af8 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
W20240503 08:12:51.344743 17493 leader_election.cc:341] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.344805 17722 ts_tablet_manager.cc:1367] T 2ee11da8ed904a74b46369a40ba83af8 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20240503 08:12:51.344857 17493 leader_election.cc:302] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.345070 17724 raft_consensus.cc:2726] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.345408 17722 raft_consensus.cc:348] T 2ee11da8ed904a74b46369a40ba83af8 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.345532 17722 raft_consensus.cc:374] T 2ee11da8ed904a74b46369a40ba83af8 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.345607 17718 tablet_bootstrap.cc:492] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.345607 17722 raft_consensus.cc:729] T 2ee11da8ed904a74b46369a40ba83af8 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.345772 17718 ts_tablet_manager.cc:1367] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.012s
I20240503 08:12:51.345858 17722 consensus_queue.cc:260] T 2ee11da8ed904a74b46369a40ba83af8 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.346269 17722 ts_tablet_manager.cc:1398] T 2ee11da8ed904a74b46369a40ba83af8 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:12:51.346493 17722 tablet_bootstrap.cc:492] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.346393 17718 raft_consensus.cc:348] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.346554 17718 raft_consensus.cc:374] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.346607 17718 raft_consensus.cc:729] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.346807 17718 consensus_queue.cc:260] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.347818 17718 ts_tablet_manager.cc:1398] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.348090 17718 tablet_bootstrap.cc:492] T b0dd68775f514b6b983f28fd87d9e4ec P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.348425 17722 tablet_bootstrap.cc:654] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.350487 17718 tablet_bootstrap.cc:654] T b0dd68775f514b6b983f28fd87d9e4ec P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.352046 17719 tablet_bootstrap.cc:654] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.353682 17718 tablet_bootstrap.cc:492] T b0dd68775f514b6b983f28fd87d9e4ec P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.353863 17718 ts_tablet_manager.cc:1367] T b0dd68775f514b6b983f28fd87d9e4ec P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20240503 08:12:51.354593 17718 raft_consensus.cc:348] T b0dd68775f514b6b983f28fd87d9e4ec P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.354841 17718 raft_consensus.cc:374] T b0dd68775f514b6b983f28fd87d9e4ec P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.354931 17718 raft_consensus.cc:729] T b0dd68775f514b6b983f28fd87d9e4ec P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.355202 17718 consensus_queue.cc:260] T b0dd68775f514b6b983f28fd87d9e4ec P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.355867 17718 ts_tablet_manager.cc:1398] T b0dd68775f514b6b983f28fd87d9e4ec P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.356168 17718 tablet_bootstrap.cc:492] T aee53c998fb44359b24cb8bf1e9ae658 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.357895 17718 tablet_bootstrap.cc:654] T aee53c998fb44359b24cb8bf1e9ae658 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.358795 17425 catalog_manager.cc:5484] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:51.366119 17722 tablet_bootstrap.cc:492] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.366264 17722 ts_tablet_manager.cc:1367] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.010s
I20240503 08:12:51.367004 17719 tablet_bootstrap.cc:492] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.366969 17722 raft_consensus.cc:348] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.367004 17718 tablet_bootstrap.cc:492] T aee53c998fb44359b24cb8bf1e9ae658 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.367141 17722 raft_consensus.cc:374] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.367161 17719 ts_tablet_manager.cc:1367] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.025s user 0.013s sys 0.001s
I20240503 08:12:51.367267 17722 raft_consensus.cc:729] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.367385 17718 ts_tablet_manager.cc:1367] T aee53c998fb44359b24cb8bf1e9ae658 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20240503 08:12:51.367543 17722 consensus_queue.cc:260] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.367857 17719 raft_consensus.cc:348] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.368075 17719 raft_consensus.cc:374] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.368033 17718 raft_consensus.cc:348] T aee53c998fb44359b24cb8bf1e9ae658 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.368134 17719 raft_consensus.cc:729] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.368145 17722 ts_tablet_manager.cc:1398] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.368185 17718 raft_consensus.cc:374] T aee53c998fb44359b24cb8bf1e9ae658 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.368227 17718 raft_consensus.cc:729] T aee53c998fb44359b24cb8bf1e9ae658 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.368413 17722 tablet_bootstrap.cc:492] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.368335 17719 consensus_queue.cc:260] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.368398 17718 consensus_queue.cc:260] T aee53c998fb44359b24cb8bf1e9ae658 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.369005 17718 ts_tablet_manager.cc:1398] T aee53c998fb44359b24cb8bf1e9ae658 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:12:51.369261 17718 tablet_bootstrap.cc:492] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.370477 17722 tablet_bootstrap.cc:654] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.371201 17718 tablet_bootstrap.cc:654] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.372723 17719 ts_tablet_manager.cc:1398] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240503 08:12:51.372965 17719 tablet_bootstrap.cc:492] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.374416 17719 tablet_bootstrap.cc:654] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.377080 17719 tablet_bootstrap.cc:492] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.377215 17719 ts_tablet_manager.cc:1367] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240503 08:12:51.377439 17718 tablet_bootstrap.cc:492] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.377562 17718 ts_tablet_manager.cc:1367] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.005s
I20240503 08:12:51.377871 17722 tablet_bootstrap.cc:492] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.377816 17719 raft_consensus.cc:348] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.377954 17719 raft_consensus.cc:374] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.377992 17722 ts_tablet_manager.cc:1367] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20240503 08:12:51.378010 17719 raft_consensus.cc:729] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.378141 17718 raft_consensus.cc:348] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.378207 17719 consensus_queue.cc:260] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.378310 17718 raft_consensus.cc:374] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.378369 17718 raft_consensus.cc:729] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.378561 17722 raft_consensus.cc:348] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.378553 17718 consensus_queue.cc:260] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.378736 17722 raft_consensus.cc:374] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.378780 17722 raft_consensus.cc:729] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.378947 17722 consensus_queue.cc:260] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.379176 17718 ts_tablet_manager.cc:1398] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.379433 17718 tablet_bootstrap.cc:492] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.379429 17719 ts_tablet_manager.cc:1398] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.379707 17719 tablet_bootstrap.cc:492] T b5726229454f477d8e526198ede45aab P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.380283 17722 ts_tablet_manager.cc:1398] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.380520 17722 tablet_bootstrap.cc:492] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.380946 17718 tablet_bootstrap.cc:654] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.381933 17722 tablet_bootstrap.cc:654] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.384574 17719 tablet_bootstrap.cc:654] T b5726229454f477d8e526198ede45aab P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.386746 17719 tablet_bootstrap.cc:492] T b5726229454f477d8e526198ede45aab P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.386860 17719 ts_tablet_manager.cc:1367] T b5726229454f477d8e526198ede45aab P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240503 08:12:51.387338 17719 raft_consensus.cc:348] T b5726229454f477d8e526198ede45aab P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.387522 17719 raft_consensus.cc:374] T b5726229454f477d8e526198ede45aab P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.387578 17719 raft_consensus.cc:729] T b5726229454f477d8e526198ede45aab P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.387777 17719 consensus_queue.cc:260] T b5726229454f477d8e526198ede45aab P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.388314 17719 ts_tablet_manager.cc:1398] T b5726229454f477d8e526198ede45aab P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240503 08:12:51.388406 17722 tablet_bootstrap.cc:492] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.388406 17718 tablet_bootstrap.cc:492] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.388557 17718 ts_tablet_manager.cc:1367] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20240503 08:12:51.388557 17722 ts_tablet_manager.cc:1367] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.004s
I20240503 08:12:51.388707 17719 tablet_bootstrap.cc:492] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.389220 17718 raft_consensus.cc:348] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.389206 17722 raft_consensus.cc:348] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.389403 17718 raft_consensus.cc:374] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.389443 17722 raft_consensus.cc:374] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.389472 17718 raft_consensus.cc:729] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.389496 17722 raft_consensus.cc:729] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.389678 17722 consensus_queue.cc:260] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.389672 17718 consensus_queue.cc:260] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.390236 17718 ts_tablet_manager.cc:1398] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.390260 17722 ts_tablet_manager.cc:1398] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.390503 17718 tablet_bootstrap.cc:492] T 761ee807456f4691bb8ae39350bff31c P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.390503 17722 tablet_bootstrap.cc:492] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.392105 17718 tablet_bootstrap.cc:654] T 761ee807456f4691bb8ae39350bff31c P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.392117 17722 tablet_bootstrap.cc:654] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.392190 17746 raft_consensus.cc:482] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.392313 17746 raft_consensus.cc:504] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.392953 17746 leader_election.cc:288] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.393730 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0dd68775f514b6b983f28fd87d9e4ec" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.393900 17528 raft_consensus.cc:2454] T b0dd68775f514b6b983f28fd87d9e4ec P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.394142 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0dd68775f514b6b983f28fd87d9e4ec" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.394304 17604 raft_consensus.cc:2454] T b0dd68775f514b6b983f28fd87d9e4ec P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.394630 17641 leader_election.cc:302] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.395495 17746 raft_consensus.cc:2781] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.395574 17746 raft_consensus.cc:482] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.395634 17746 raft_consensus.cc:3037] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.396591 17719 tablet_bootstrap.cc:654] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.398451 17746 raft_consensus.cc:504] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.399070 17746 leader_election.cc:288] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.399644 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0dd68775f514b6b983f28fd87d9e4ec" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.399816 17604 raft_consensus.cc:3037] T b0dd68775f514b6b983f28fd87d9e4ec P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.401121 17718 tablet_bootstrap.cc:492] T 761ee807456f4691bb8ae39350bff31c P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.401211 17722 tablet_bootstrap.cc:492] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.401293 17718 ts_tablet_manager.cc:1367] T 761ee807456f4691bb8ae39350bff31c P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20240503 08:12:51.401310 17722 ts_tablet_manager.cc:1367] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20240503 08:12:51.402066 17722 raft_consensus.cc:348] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.402063 17718 raft_consensus.cc:348] T 761ee807456f4691bb8ae39350bff31c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.402283 17722 raft_consensus.cc:374] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.402312 17718 raft_consensus.cc:374] T 761ee807456f4691bb8ae39350bff31c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.402340 17722 raft_consensus.cc:729] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.402372 17718 raft_consensus.cc:729] T 761ee807456f4691bb8ae39350bff31c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.402524 17718 consensus_queue.cc:260] T 761ee807456f4691bb8ae39350bff31c P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.402524 17722 consensus_queue.cc:260] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.402948 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0dd68775f514b6b983f28fd87d9e4ec" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.403136 17528 raft_consensus.cc:3037] T b0dd68775f514b6b983f28fd87d9e4ec P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.403714 17722 ts_tablet_manager.cc:1398] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.403976 17722 tablet_bootstrap.cc:492] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.404775 17604 raft_consensus.cc:2454] T b0dd68775f514b6b983f28fd87d9e4ec P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.405380 17644 leader_election.cc:302] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.405629 17746 raft_consensus.cc:2781] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.405732 17718 ts_tablet_manager.cc:1398] T 761ee807456f4691bb8ae39350bff31c P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:12:51.405818 17746 raft_consensus.cc:686] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:51.405975 17718 tablet_bootstrap.cc:492] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.406054 17746 consensus_queue.cc:237] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.411712 17719 tablet_bootstrap.cc:492] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.411863 17719 ts_tablet_manager.cc:1367] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.008s
I20240503 08:12:51.412608 17719 raft_consensus.cc:348] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.412784 17719 raft_consensus.cc:374] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.412833 17719 raft_consensus.cc:729] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.413036 17719 consensus_queue.cc:260] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.413405 17528 raft_consensus.cc:2454] T b0dd68775f514b6b983f28fd87d9e4ec P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.413537 17719 ts_tablet_manager.cc:1398] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:51.414356 17719 tablet_bootstrap.cc:492] T 761ee807456f4691bb8ae39350bff31c P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.415494 17426 catalog_manager.cc:5484] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:51.416139 17718 tablet_bootstrap.cc:654] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.416498 17729 raft_consensus.cc:482] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.416612 17729 raft_consensus.cc:504] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.417204 17729 leader_election.cc:288] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.417672 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e5a4235b0d0427cb308ae894cb0b00a" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.417827 17604 raft_consensus.cc:2454] T 5e5a4235b0d0427cb308ae894cb0b00a P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.418175 17644 leader_election.cc:302] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.418450 17729 raft_consensus.cc:2781] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.418521 17729 raft_consensus.cc:482] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.418577 17729 raft_consensus.cc:3037] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.419567 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e5a4235b0d0427cb308ae894cb0b00a" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.419771 17528 raft_consensus.cc:2454] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.420374 17719 tablet_bootstrap.cc:654] T 761ee807456f4691bb8ae39350bff31c P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.421396 17729 raft_consensus.cc:504] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.422259 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e5a4235b0d0427cb308ae894cb0b00a" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.422456 17528 raft_consensus.cc:3037] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.422536 17729 leader_election.cc:288] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.415509 17722 tablet_bootstrap.cc:654] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.422413 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e5a4235b0d0427cb308ae894cb0b00a" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.425598 17604 raft_consensus.cc:3037] T 5e5a4235b0d0427cb308ae894cb0b00a P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.428081 17722 tablet_bootstrap.cc:492] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.428225 17722 ts_tablet_manager.cc:1367] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.005s
I20240503 08:12:51.428611 17604 raft_consensus.cc:2454] T 5e5a4235b0d0427cb308ae894cb0b00a P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.428699 17746 raft_consensus.cc:482] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.428812 17746 raft_consensus.cc:504] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.429041 17644 leader_election.cc:302] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.429364 17729 raft_consensus.cc:2781] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.429477 17729 raft_consensus.cc:686] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:51.429725 17729 consensus_queue.cc:237] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.429781 17529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14598a4f2af1413b835d50517b27f305" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
W20240503 08:12:51.430284 17641 leader_election.cc:341] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.430598 17746 leader_election.cc:288] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.431130 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14598a4f2af1413b835d50517b27f305" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.431344 17722 raft_consensus.cc:348] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.431551 17722 raft_consensus.cc:374] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.431605 17722 raft_consensus.cc:729] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
W20240503 08:12:51.431636 17644 leader_election.cc:341] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.431747 17644 leader_election.cc:302] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2; no voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.431808 17722 consensus_queue.cc:260] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.432085 17744 raft_consensus.cc:2726] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.432519 17722 ts_tablet_manager.cc:1398] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:12:51.432787 17722 tablet_bootstrap.cc:492] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.433699 17528 raft_consensus.cc:2454] T 5e5a4235b0d0427cb308ae894cb0b00a P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.434963 17722 tablet_bootstrap.cc:654] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.438138 17718 tablet_bootstrap.cc:492] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.438270 17718 ts_tablet_manager.cc:1367] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.032s user 0.009s sys 0.014s
I20240503 08:12:51.438203 17426 catalog_manager.cc:5484] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:51.438874 17719 tablet_bootstrap.cc:492] T 761ee807456f4691bb8ae39350bff31c P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.438937 17718 raft_consensus.cc:348] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.439087 17719 ts_tablet_manager.cc:1367] T 761ee807456f4691bb8ae39350bff31c P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.025s user 0.015s sys 0.003s
I20240503 08:12:51.439114 17718 raft_consensus.cc:374] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.439275 17718 raft_consensus.cc:729] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.439487 17718 consensus_queue.cc:260] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.439728 17722 tablet_bootstrap.cc:492] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.439836 17722 ts_tablet_manager.cc:1367] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20240503 08:12:51.439980 17718 ts_tablet_manager.cc:1398] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:51.440316 17718 tablet_bootstrap.cc:492] T 14598a4f2af1413b835d50517b27f305 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.440250 17719 raft_consensus.cc:348] T 761ee807456f4691bb8ae39350bff31c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.440409 17722 raft_consensus.cc:348] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.440522 17719 raft_consensus.cc:374] T 761ee807456f4691bb8ae39350bff31c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.440552 17722 raft_consensus.cc:374] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.440681 17719 raft_consensus.cc:729] T 761ee807456f4691bb8ae39350bff31c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.440696 17722 raft_consensus.cc:729] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.441011 17719 consensus_queue.cc:260] T 761ee807456f4691bb8ae39350bff31c P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.441538 17719 ts_tablet_manager.cc:1398] T 761ee807456f4691bb8ae39350bff31c P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:51.441011 17722 consensus_queue.cc:260] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.441810 17718 tablet_bootstrap.cc:654] T 14598a4f2af1413b835d50517b27f305 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.442070 17722 ts_tablet_manager.cc:1398] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:12:51.442239 17719 tablet_bootstrap.cc:492] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.442371 17722 tablet_bootstrap.cc:492] T aee53c998fb44359b24cb8bf1e9ae658 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.443816 17719 tablet_bootstrap.cc:654] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.443816 17722 tablet_bootstrap.cc:654] T aee53c998fb44359b24cb8bf1e9ae658 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.450444 17718 tablet_bootstrap.cc:492] T 14598a4f2af1413b835d50517b27f305 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.450592 17718 ts_tablet_manager.cc:1367] T 14598a4f2af1413b835d50517b27f305 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.004s
I20240503 08:12:51.451314 17718 raft_consensus.cc:348] T 14598a4f2af1413b835d50517b27f305 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.451543 17718 raft_consensus.cc:374] T 14598a4f2af1413b835d50517b27f305 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.451663 17718 raft_consensus.cc:729] T 14598a4f2af1413b835d50517b27f305 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.451545 17729 raft_consensus.cc:482] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.451901 17718 consensus_queue.cc:260] T 14598a4f2af1413b835d50517b27f305 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.451907 17729 raft_consensus.cc:504] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.452368 17718 ts_tablet_manager.cc:1398] T 14598a4f2af1413b835d50517b27f305 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:51.452600 17718 tablet_bootstrap.cc:492] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.452622 17729 leader_election.cc:288] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.453455 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "761ee807456f4691bb8ae39350bff31c" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.454226 17718 tablet_bootstrap.cc:654] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.455196 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "761ee807456f4691bb8ae39350bff31c" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.455381 17604 raft_consensus.cc:2454] T 761ee807456f4691bb8ae39350bff31c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.455785 17644 leader_election.cc:302] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.456267 17528 raft_consensus.cc:2454] T 761ee807456f4691bb8ae39350bff31c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.456940 17729 raft_consensus.cc:2781] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.457038 17729 raft_consensus.cc:482] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.457131 17729 raft_consensus.cc:3037] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.457664 17718 tablet_bootstrap.cc:492] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.457759 17718 ts_tablet_manager.cc:1367] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20240503 08:12:51.458277 17718 raft_consensus.cc:348] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.458400 17718 raft_consensus.cc:374] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.458433 17718 raft_consensus.cc:729] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.458590 17718 consensus_queue.cc:260] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.458984 17718 ts_tablet_manager.cc:1398] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:51.459275 17718 tablet_bootstrap.cc:492] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.460361 17729 raft_consensus.cc:504] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.460870 17718 tablet_bootstrap.cc:654] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.461736 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "761ee807456f4691bb8ae39350bff31c" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.461921 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "761ee807456f4691bb8ae39350bff31c" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.462030 17729 leader_election.cc:288] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.462116 17528 raft_consensus.cc:3037] T 761ee807456f4691bb8ae39350bff31c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.461933 17604 raft_consensus.cc:3037] T 761ee807456f4691bb8ae39350bff31c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.465209 17528 raft_consensus.cc:2454] T 761ee807456f4691bb8ae39350bff31c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.466578 17604 raft_consensus.cc:2454] T 761ee807456f4691bb8ae39350bff31c P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.467051 17724 raft_consensus.cc:482] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.467177 17724 raft_consensus.cc:504] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.467849 17724 leader_election.cc:288] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.468109 17641 leader_election.cc:302] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.468271 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "675688b228f147f8a88e69f43b91ef0c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.468721 17729 raft_consensus.cc:2781] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
W20240503 08:12:51.468844 17493 leader_election.cc:341] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.468892 17729 raft_consensus.cc:686] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:51.469097 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "675688b228f147f8a88e69f43b91ef0c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.469202 17729 consensus_queue.cc:237] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
W20240503 08:12:51.469542 17495 leader_election.cc:341] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.469659 17495 leader_election.cc:302] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.469971 17724 raft_consensus.cc:2726] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.472795 17722 tablet_bootstrap.cc:492] T aee53c998fb44359b24cb8bf1e9ae658 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.473037 17722 ts_tablet_manager.cc:1367] T aee53c998fb44359b24cb8bf1e9ae658 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.005s
I20240503 08:12:51.473929 17722 raft_consensus.cc:348] T aee53c998fb44359b24cb8bf1e9ae658 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.474220 17722 raft_consensus.cc:374] T aee53c998fb44359b24cb8bf1e9ae658 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.474359 17722 raft_consensus.cc:729] T aee53c998fb44359b24cb8bf1e9ae658 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.474673 17722 consensus_queue.cc:260] T aee53c998fb44359b24cb8bf1e9ae658 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.475499 17722 ts_tablet_manager.cc:1398] T aee53c998fb44359b24cb8bf1e9ae658 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.475888 17722 tablet_bootstrap.cc:492] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.476594 17746 raft_consensus.cc:482] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.476740 17746 raft_consensus.cc:504] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.476814 17724 raft_consensus.cc:482] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.476958 17724 raft_consensus.cc:504] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.477427 17746 leader_election.cc:288] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.477624 17724 leader_election.cc:288] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.478173 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01c1231eca744af282822464f9af362e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.478382 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01c1231eca744af282822464f9af362e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.478914 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "519eb7f46c59460ba3b4a5613ff54894" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.479133 17603 raft_consensus.cc:2454] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:51.478947 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "519eb7f46c59460ba3b4a5613ff54894" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.479645 17677 raft_consensus.cc:2454] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
W20240503 08:12:51.480100 17644 leader_election.cc:341] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.480652 17493 leader_election.cc:302] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
W20240503 08:12:51.480916 17641 leader_election.cc:341] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.481734 17641 leader_election.cc:302] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2; no voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.482195 17746 raft_consensus.cc:2726] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.482751 17724 raft_consensus.cc:2781] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.483104 17724 raft_consensus.cc:482] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.483232 17724 raft_consensus.cc:3037] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.486596 17724 raft_consensus.cc:504] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.487813 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "519eb7f46c59460ba3b4a5613ff54894" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.488024 17603 raft_consensus.cc:3037] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.491267 17603 raft_consensus.cc:2454] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:51.492027 17723 raft_consensus.cc:482] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.492185 17723 raft_consensus.cc:504] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.492877 17723 leader_election.cc:288] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.493552 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ee11da8ed904a74b46369a40ba83af8" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.493773 17677 raft_consensus.cc:2454] T 2ee11da8ed904a74b46369a40ba83af8 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:51.494473 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ee11da8ed904a74b46369a40ba83af8" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.494716 17528 raft_consensus.cc:2454] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:51.495218 17495 leader_election.cc:302] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.494725 17568 leader_election.cc:302] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.496127 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "519eb7f46c59460ba3b4a5613ff54894" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.496229 17723 raft_consensus.cc:2781] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.496371 17723 raft_consensus.cc:482] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.496469 17723 raft_consensus.cc:3037] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.496569 17724 leader_election.cc:288] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.496819 17724 raft_consensus.cc:2781] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.497053 17724 raft_consensus.cc:686] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:51.497514 17724 consensus_queue.cc:237] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.498752 17746 raft_consensus.cc:482] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.498930 17746 raft_consensus.cc:504] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.499493 17677 raft_consensus.cc:3037] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.499657 17746 leader_election.cc:288] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.501127 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2057a35eb684e41bac23078e6526b08" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.501590 17603 raft_consensus.cc:2454] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.502094 17644 leader_election.cc:302] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.502925 17746 raft_consensus.cc:2781] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.503054 17746 raft_consensus.cc:482] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.503154 17746 raft_consensus.cc:3037] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.504331 17723 raft_consensus.cc:504] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.506278 17746 raft_consensus.cc:504] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.507699 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ee11da8ed904a74b46369a40ba83af8" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.507951 17678 raft_consensus.cc:3037] T 2ee11da8ed904a74b46369a40ba83af8 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.508111 17746 leader_election.cc:288] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.506289 17677 raft_consensus.cc:2454] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:51.510182 17722 tablet_bootstrap.cc:654] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.511217 17678 raft_consensus.cc:2454] T 2ee11da8ed904a74b46369a40ba83af8 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.507920 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2057a35eb684e41bac23078e6526b08" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.511658 17604 raft_consensus.cc:3037] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.513833 17719 tablet_bootstrap.cc:492] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.513993 17719 ts_tablet_manager.cc:1367] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.072s user 0.046s sys 0.024s
I20240503 08:12:51.513873 17426 catalog_manager.cc:5484] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:51.514330 17604 raft_consensus.cc:2454] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.514861 17644 leader_election.cc:302] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.515035 17568 leader_election.cc:302] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.515146 17719 raft_consensus.cc:348] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.515352 17719 raft_consensus.cc:374] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.515473 17719 raft_consensus.cc:729] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.515741 17719 consensus_queue.cc:260] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.517105 17722 tablet_bootstrap.cc:492] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.517288 17722 ts_tablet_manager.cc:1367] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.000s
I20240503 08:12:51.518075 17722 raft_consensus.cc:348] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.518292 17722 raft_consensus.cc:374] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.518397 17722 raft_consensus.cc:729] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.518640 17722 consensus_queue.cc:260] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.518944 17746 raft_consensus.cc:2781] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.519145 17722 ts_tablet_manager.cc:1398] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:12:51.519291 17746 raft_consensus.cc:686] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:51.519487 17722 tablet_bootstrap.cc:492] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.519703 17746 consensus_queue.cc:237] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.521122 17722 tablet_bootstrap.cc:654] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.522037 17723 leader_election.cc:288] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.523015 17723 raft_consensus.cc:2781] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.523608 17723 raft_consensus.cc:686] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:51.523991 17723 consensus_queue.cc:237] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.533154 17718 tablet_bootstrap.cc:492] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.533371 17718 ts_tablet_manager.cc:1367] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.074s user 0.023s sys 0.008s
I20240503 08:12:51.533811 17746 raft_consensus.cc:482] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.533983 17746 raft_consensus.cc:504] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.534193 17718 raft_consensus.cc:348] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.534380 17718 raft_consensus.cc:374] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.534484 17718 raft_consensus.cc:729] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.534713 17718 consensus_queue.cc:260] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.535550 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f868a4bdfb403fa462b79cc5507546" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.535883 17604 raft_consensus.cc:2454] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.536296 17746 leader_election.cc:288] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.536456 17719 ts_tablet_manager.cc:1398] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.017s user 0.000s sys 0.010s
I20240503 08:12:51.536778 17719 tablet_bootstrap.cc:492] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.536741 17426 catalog_manager.cc:5484] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:51.539626 17719 tablet_bootstrap.cc:654] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.542081 17427 catalog_manager.cc:5484] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:51.543915 17786 raft_consensus.cc:482] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.544080 17786 raft_consensus.cc:504] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.544857 17786 leader_election.cc:288] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.545518 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aee53c998fb44359b24cb8bf1e9ae658" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.545722 17678 raft_consensus.cc:2454] T aee53c998fb44359b24cb8bf1e9ae658 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:51.546142 17568 leader_election.cc:302] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.546408 17786 raft_consensus.cc:2781] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.546525 17786 raft_consensus.cc:482] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.546617 17786 raft_consensus.cc:3037] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.548128 17644 leader_election.cc:302] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.548560 17746 raft_consensus.cc:2781] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.548671 17746 raft_consensus.cc:482] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.548847 17746 raft_consensus.cc:3037] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.551854 17746 raft_consensus.cc:504] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.554575 17786 raft_consensus.cc:504] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.555888 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f868a4bdfb403fa462b79cc5507546" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.556113 17604 raft_consensus.cc:3037] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.559216 17604 raft_consensus.cc:2454] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.559729 17644 leader_election.cc:302] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.560030 17729 raft_consensus.cc:2781] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.560189 17729 raft_consensus.cc:686] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:51.560488 17729 consensus_queue.cc:237] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.562134 17746 leader_election.cc:288] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.563920 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aee53c998fb44359b24cb8bf1e9ae658" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.564167 17678 raft_consensus.cc:3037] T aee53c998fb44359b24cb8bf1e9ae658 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.567270 17678 raft_consensus.cc:2454] T aee53c998fb44359b24cb8bf1e9ae658 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.567773 17568 leader_election.cc:302] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.568078 17785 raft_consensus.cc:2781] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.568295 17786 leader_election.cc:288] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
W20240503 08:12:51.572175 17495 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.10.66:39107, user_credentials={real_user=slave}} blocked reactor thread for 76963.7us
I20240503 08:12:51.572579 17782 raft_consensus.cc:482] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.572746 17782 raft_consensus.cc:504] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.573344 17718 ts_tablet_manager.cc:1398] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.040s user 0.010s sys 0.011s
I20240503 08:12:51.573621 17782 leader_election.cc:288] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.573735 17718 tablet_bootstrap.cc:492] T 01c1231eca744af282822464f9af362e P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.574819 17719 tablet_bootstrap.cc:492] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.575001 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ee11da8ed904a74b46369a40ba83af8" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.575217 17528 raft_consensus.cc:3037] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.575387 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aee53c998fb44359b24cb8bf1e9ae658" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.575650 17527 raft_consensus.cc:3037] T aee53c998fb44359b24cb8bf1e9ae658 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.575623 17526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2057a35eb684e41bac23078e6526b08" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.576061 17526 raft_consensus.cc:2454] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.575225 17529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aee53c998fb44359b24cb8bf1e9ae658" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.578167 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2057a35eb684e41bac23078e6526b08" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.578444 17719 ts_tablet_manager.cc:1367] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.029s
I20240503 08:12:51.578922 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2057a35eb684e41bac23078e6526b08" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.580579 17524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f868a4bdfb403fa462b79cc5507546" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.577912 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f868a4bdfb403fa462b79cc5507546" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.581997 17603 raft_consensus.cc:2379] T f2057a35eb684e41bac23078e6526b08 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06335016e7f84df18efcdfacbab289b2 in current term 1: Already voted for candidate 0d15e9450254455f8e3a1d2b194661a2 in this term.
I20240503 08:12:51.582190 17524 raft_consensus.cc:2454] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.580031 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2057a35eb684e41bac23078e6526b08" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.582865 17525 raft_consensus.cc:3037] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.584048 17722 tablet_bootstrap.cc:492] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.584359 17722 ts_tablet_manager.cc:1367] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.065s user 0.014s sys 0.009s
I20240503 08:12:51.585634 17427 catalog_manager.cc:5484] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:51.586154 17719 raft_consensus.cc:348] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.586817 17722 raft_consensus.cc:348] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.587002 17722 raft_consensus.cc:374] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.587106 17722 raft_consensus.cc:729] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.587321 17722 consensus_queue.cc:260] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.587884 17722 ts_tablet_manager.cc:1398] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240503 08:12:51.588156 17722 tablet_bootstrap.cc:492] T b5726229454f477d8e526198ede45aab P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.589195 17527 raft_consensus.cc:2454] T aee53c998fb44359b24cb8bf1e9ae658 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.588917 17528 raft_consensus.cc:2454] T 2ee11da8ed904a74b46369a40ba83af8 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.589695 17495 leader_election.cc:302] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.590126 17426 catalog_manager.cc:5484] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:51.589896 17719 raft_consensus.cc:374] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.590647 17719 raft_consensus.cc:729] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.589877 17722 tablet_bootstrap.cc:654] T b5726229454f477d8e526198ede45aab P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.591475 17719 consensus_queue.cc:260] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.593429 17719 ts_tablet_manager.cc:1398] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20240503 08:12:51.593711 17719 tablet_bootstrap.cc:492] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.594327 17525 raft_consensus.cc:2454] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.594677 17782 raft_consensus.cc:2726] T f2057a35eb684e41bac23078e6526b08 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.594841 17718 tablet_bootstrap.cc:654] T 01c1231eca744af282822464f9af362e P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.595824 17785 raft_consensus.cc:686] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:51.596105 17785 consensus_queue.cc:237] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.597057 17719 tablet_bootstrap.cc:654] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.600864 17793 raft_consensus.cc:482] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.601003 17793 raft_consensus.cc:504] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.602067 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14598a4f2af1413b835d50517b27f305" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.602257 17525 raft_consensus.cc:2454] T 14598a4f2af1413b835d50517b27f305 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:51.602563 17567 leader_election.cc:302] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.602803 17723 raft_consensus.cc:2781] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.602878 17723 raft_consensus.cc:482] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.602928 17723 raft_consensus.cc:3037] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.602950 17793 leader_election.cc:288] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.603343 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14598a4f2af1413b835d50517b27f305" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.603555 17678 raft_consensus.cc:2454] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:51.605403 17723 raft_consensus.cc:504] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.605978 17782 raft_consensus.cc:482] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.606122 17782 raft_consensus.cc:504] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.606597 17782 leader_election.cc:288] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.607120 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14377788ca9f4bb4af727da959857d9c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.607214 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14598a4f2af1413b835d50517b27f305" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.607298 17678 raft_consensus.cc:2454] T 14377788ca9f4bb4af727da959857d9c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:51.607353 17525 raft_consensus.cc:3037] T 14598a4f2af1413b835d50517b27f305 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.607736 17493 leader_election.cc:302] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.607968 17782 raft_consensus.cc:2781] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.608036 17782 raft_consensus.cc:482] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.608095 17782 raft_consensus.cc:3037] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.609974 17525 raft_consensus.cc:2454] T 14598a4f2af1413b835d50517b27f305 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.610437 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14377788ca9f4bb4af727da959857d9c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.610487 17782 raft_consensus.cc:504] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.610600 17603 raft_consensus.cc:2454] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:51.611274 17567 leader_election.cc:302] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.611425 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14377788ca9f4bb4af727da959857d9c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.611546 17793 raft_consensus.cc:2781] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.611590 17782 leader_election.cc:288] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.611675 17793 raft_consensus.cc:686] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:51.611732 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14377788ca9f4bb4af727da959857d9c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.611869 17603 raft_consensus.cc:3037] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.611943 17793 consensus_queue.cc:237] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.611564 17678 raft_consensus.cc:3037] T 14377788ca9f4bb4af727da959857d9c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.614217 17603 raft_consensus.cc:2454] T 14377788ca9f4bb4af727da959857d9c P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:51.614588 17495 leader_election.cc:302] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.614804 17782 raft_consensus.cc:2781] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.614917 17782 raft_consensus.cc:686] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:51.614943 17723 leader_election.cc:288] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.615137 17678 raft_consensus.cc:2454] T 14377788ca9f4bb4af727da959857d9c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:51.615167 17782 consensus_queue.cc:237] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.616837 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14598a4f2af1413b835d50517b27f305" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.616991 17678 raft_consensus.cc:3037] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.618799 17719 tablet_bootstrap.cc:492] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.618947 17719 ts_tablet_manager.cc:1367] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.015s
I20240503 08:12:51.619153 17678 raft_consensus.cc:2454] T 14598a4f2af1413b835d50517b27f305 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.619688 17719 raft_consensus.cc:348] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } }
I20240503 08:12:51.619869 17719 raft_consensus.cc:374] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.619921 17719 raft_consensus.cc:729] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.620115 17719 consensus_queue.cc:260] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } }
I20240503 08:12:51.620570 17719 ts_tablet_manager.cc:1398] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:51.620831 17719 tablet_bootstrap.cc:492] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.622279 17719 tablet_bootstrap.cc:654] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.624168 17719 tablet_bootstrap.cc:492] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.624301 17719 ts_tablet_manager.cc:1367] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:12:51.624894 17719 raft_consensus.cc:348] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.624689 17427 catalog_manager.cc:5484] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:51.625061 17719 raft_consensus.cc:374] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.625110 17719 raft_consensus.cc:729] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.625325 17719 consensus_queue.cc:260] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.625533 17722 tablet_bootstrap.cc:492] T b5726229454f477d8e526198ede45aab P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.625638 17722 ts_tablet_manager.cc:1367] T b5726229454f477d8e526198ede45aab P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.004s
I20240503 08:12:51.625943 17719 ts_tablet_manager.cc:1398] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.626178 17719 tablet_bootstrap.cc:492] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.627574 17719 tablet_bootstrap.cc:654] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.624689 17718 tablet_bootstrap.cc:492] T 01c1231eca744af282822464f9af362e P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.628077 17718 ts_tablet_manager.cc:1367] T 01c1231eca744af282822464f9af362e P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.006s
I20240503 08:12:51.628741 17718 raft_consensus.cc:348] T 01c1231eca744af282822464f9af362e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.626173 17722 raft_consensus.cc:348] T b5726229454f477d8e526198ede45aab P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.629122 17722 raft_consensus.cc:374] T b5726229454f477d8e526198ede45aab P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.629171 17718 raft_consensus.cc:374] T 01c1231eca744af282822464f9af362e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.629187 17722 raft_consensus.cc:729] T b5726229454f477d8e526198ede45aab P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.629316 17718 raft_consensus.cc:729] T 01c1231eca744af282822464f9af362e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.629547 17718 consensus_queue.cc:260] T 01c1231eca744af282822464f9af362e P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.629523 17722 consensus_queue.cc:260] T b5726229454f477d8e526198ede45aab P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.630060 17718 ts_tablet_manager.cc:1398] T 01c1231eca744af282822464f9af362e P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.630331 17718 tablet_bootstrap.cc:492] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.630802 17427 catalog_manager.cc:5484] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:51.631747 17718 tablet_bootstrap.cc:654] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.632432 17722 ts_tablet_manager.cc:1398] T b5726229454f477d8e526198ede45aab P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20240503 08:12:51.634071 17722 tablet_bootstrap.cc:492] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.635617 17722 tablet_bootstrap.cc:654] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.636216 17427 catalog_manager.cc:5484] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:51.640980 17719 tablet_bootstrap.cc:492] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.641115 17719 ts_tablet_manager.cc:1367] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.003s
I20240503 08:12:51.641498 17718 tablet_bootstrap.cc:492] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.641602 17718 ts_tablet_manager.cc:1367] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20240503 08:12:51.641729 17719 raft_consensus.cc:348] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.641918 17719 raft_consensus.cc:374] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.641981 17719 raft_consensus.cc:729] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.642166 17719 consensus_queue.cc:260] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.642165 17718 raft_consensus.cc:348] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.642391 17718 raft_consensus.cc:374] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.642568 17718 raft_consensus.cc:729] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.642657 17719 ts_tablet_manager.cc:1398] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:51.642773 17718 consensus_queue.cc:260] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.642905 17719 tablet_bootstrap.cc:492] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.643222 17718 ts_tablet_manager.cc:1398] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:51.643558 17718 tablet_bootstrap.cc:492] T cf0faa2ea34146b48c0842a7878e20f3 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.644193 17719 tablet_bootstrap.cc:654] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.645025 17722 tablet_bootstrap.cc:492] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.645190 17722 ts_tablet_manager.cc:1367] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.006s
I20240503 08:12:51.645808 17718 tablet_bootstrap.cc:654] T cf0faa2ea34146b48c0842a7878e20f3 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.645805 17722 raft_consensus.cc:348] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.646000 17722 raft_consensus.cc:374] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.646052 17722 raft_consensus.cc:729] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.646261 17722 consensus_queue.cc:260] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.648694 17722 ts_tablet_manager.cc:1398] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240503 08:12:51.648973 17722 tablet_bootstrap.cc:492] T f131aca1d2274b0ba4df3499cd835616 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.650293 17722 tablet_bootstrap.cc:654] T f131aca1d2274b0ba4df3499cd835616 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.652171 17718 tablet_bootstrap.cc:492] T cf0faa2ea34146b48c0842a7878e20f3 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.652272 17718 ts_tablet_manager.cc:1367] T cf0faa2ea34146b48c0842a7878e20f3 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.002s
I20240503 08:12:51.652348 17722 tablet_bootstrap.cc:492] T f131aca1d2274b0ba4df3499cd835616 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.652520 17722 ts_tablet_manager.cc:1367] T f131aca1d2274b0ba4df3499cd835616 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20240503 08:12:51.652777 17718 raft_consensus.cc:348] T cf0faa2ea34146b48c0842a7878e20f3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.652920 17718 raft_consensus.cc:374] T cf0faa2ea34146b48c0842a7878e20f3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.652958 17718 raft_consensus.cc:729] T cf0faa2ea34146b48c0842a7878e20f3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.653118 17718 consensus_queue.cc:260] T cf0faa2ea34146b48c0842a7878e20f3 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.653326 17722 raft_consensus.cc:348] T f131aca1d2274b0ba4df3499cd835616 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.653460 17722 raft_consensus.cc:374] T f131aca1d2274b0ba4df3499cd835616 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.653512 17722 raft_consensus.cc:729] T f131aca1d2274b0ba4df3499cd835616 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.653573 17718 ts_tablet_manager.cc:1398] T cf0faa2ea34146b48c0842a7878e20f3 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:51.653681 17722 consensus_queue.cc:260] T f131aca1d2274b0ba4df3499cd835616 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.653906 17718 tablet_bootstrap.cc:492] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.654052 17722 ts_tablet_manager.cc:1398] T f131aca1d2274b0ba4df3499cd835616 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:51.654255 17722 tablet_bootstrap.cc:492] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.655215 17718 tablet_bootstrap.cc:654] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.655546 17722 tablet_bootstrap.cc:654] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.656150 17782 raft_consensus.cc:482] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.656292 17782 raft_consensus.cc:504] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.656838 17782 leader_election.cc:288] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.657214 17718 tablet_bootstrap.cc:492] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.657330 17718 ts_tablet_manager.cc:1367] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240503 08:12:51.657317 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db0fbf6819374978ab404bbfde4b9d42" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.657495 17678 raft_consensus.cc:2454] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:51.657747 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db0fbf6819374978ab404bbfde4b9d42" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.657866 17493 leader_election.cc:302] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.657974 17718 raft_consensus.cc:348] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.658134 17718 raft_consensus.cc:374] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.658197 17718 raft_consensus.cc:729] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
W20240503 08:12:51.658247 17495 leader_election.cc:341] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.658357 17718 consensus_queue.cc:260] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.658592 17790 raft_consensus.cc:2781] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.658672 17790 raft_consensus.cc:482] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.658744 17790 raft_consensus.cc:3037] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.659989 17719 tablet_bootstrap.cc:492] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.660095 17719 ts_tablet_manager.cc:1367] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.003s
I20240503 08:12:51.660601 17719 raft_consensus.cc:348] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.660753 17719 raft_consensus.cc:374] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.660797 17719 raft_consensus.cc:729] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.660943 17719 consensus_queue.cc:260] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.661360 17790 raft_consensus.cc:504] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.661945 17790 leader_election.cc:288] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.661360 17719 ts_tablet_manager.cc:1398] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:51.662168 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db0fbf6819374978ab404bbfde4b9d42" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.662287 17722 tablet_bootstrap.cc:492] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.662371 17719 tablet_bootstrap.cc:492] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.662386 17722 ts_tablet_manager.cc:1367] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
W20240503 08:12:51.662595 17495 leader_election.cc:341] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.663065 17722 raft_consensus.cc:348] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.663213 17722 raft_consensus.cc:374] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.663264 17722 raft_consensus.cc:729] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.663457 17719 tablet_bootstrap.cc:654] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.663465 17722 consensus_queue.cc:260] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.663750 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db0fbf6819374978ab404bbfde4b9d42" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.663906 17678 raft_consensus.cc:3037] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.664809 17722 ts_tablet_manager.cc:1398] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:51.665066 17722 tablet_bootstrap.cc:492] T cf0faa2ea34146b48c0842a7878e20f3 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.666294 17722 tablet_bootstrap.cc:654] T cf0faa2ea34146b48c0842a7878e20f3 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.666580 17718 ts_tablet_manager.cc:1398] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20240503 08:12:51.666690 17729 raft_consensus.cc:482] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.666836 17718 tablet_bootstrap.cc:492] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.666788 17729 raft_consensus.cc:504] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.667311 17729 leader_election.cc:288] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.668057 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "675688b228f147f8a88e69f43b91ef0c" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.668243 17718 tablet_bootstrap.cc:654] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.668347 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "675688b228f147f8a88e69f43b91ef0c" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:51.668824 17644 leader_election.cc:341] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.668228 17525 raft_consensus.cc:2454] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.669296 17641 leader_election.cc:302] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.669672 17729 raft_consensus.cc:2781] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.669734 17729 raft_consensus.cc:482] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.669790 17729 raft_consensus.cc:3037] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.671432 17790 raft_consensus.cc:482] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.671564 17790 raft_consensus.cc:504] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.672523 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5726229454f477d8e526198ede45aab" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.672688 17677 raft_consensus.cc:2454] T b5726229454f477d8e526198ede45aab P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:51.672645 17729 raft_consensus.cc:504] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.673156 17493 leader_election.cc:302] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.673493 17790 leader_election.cc:288] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.673516 17782 raft_consensus.cc:2781] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.673782 17782 raft_consensus.cc:482] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.673866 17782 raft_consensus.cc:3037] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.675809 17782 raft_consensus.cc:504] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.676077 17719 tablet_bootstrap.cc:492] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.676215 17719 ts_tablet_manager.cc:1367] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.006s
I20240503 08:12:51.676422 17722 tablet_bootstrap.cc:492] T cf0faa2ea34146b48c0842a7878e20f3 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.676548 17722 ts_tablet_manager.cc:1367] T cf0faa2ea34146b48c0842a7878e20f3 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.002s
I20240503 08:12:51.676542 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "675688b228f147f8a88e69f43b91ef0c" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.676695 17525 raft_consensus.cc:3037] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.676813 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5726229454f477d8e526198ede45aab" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.676949 17677 raft_consensus.cc:3037] T b5726229454f477d8e526198ede45aab P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.676930 17719 raft_consensus.cc:348] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.677073 17719 raft_consensus.cc:374] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.677125 17719 raft_consensus.cc:729] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.677220 17722 raft_consensus.cc:348] T cf0faa2ea34146b48c0842a7878e20f3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.677362 17722 raft_consensus.cc:374] T cf0faa2ea34146b48c0842a7878e20f3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.677403 17722 raft_consensus.cc:729] T cf0faa2ea34146b48c0842a7878e20f3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.677325 17719 consensus_queue.cc:260] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.677582 17722 consensus_queue.cc:260] T cf0faa2ea34146b48c0842a7878e20f3 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.679065 17525 raft_consensus.cc:2454] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.679384 17677 raft_consensus.cc:2454] T b5726229454f477d8e526198ede45aab P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:51.679698 17719 ts_tablet_manager.cc:1398] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240503 08:12:51.679980 17719 tablet_bootstrap.cc:492] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.679934 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5726229454f477d8e526198ede45aab" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.680061 17493 leader_election.cc:302] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.680285 17641 leader_election.cc:302] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.680545 17746 raft_consensus.cc:2781] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.680685 17746 raft_consensus.cc:686] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:51.680780 17790 raft_consensus.cc:2781] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.680914 17790 raft_consensus.cc:686] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:51.680950 17746 consensus_queue.cc:237] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.681067 17722 ts_tablet_manager.cc:1398] T cf0faa2ea34146b48c0842a7878e20f3 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:12:51.681162 17790 consensus_queue.cc:237] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.681613 17719 tablet_bootstrap.cc:654] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.681941 17722 tablet_bootstrap.cc:492] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.680099 17604 raft_consensus.cc:3037] T b5726229454f477d8e526198ede45aab P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.682986 17718 tablet_bootstrap.cc:492] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.683145 17718 ts_tablet_manager.cc:1367] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.004s
I20240503 08:12:51.683678 17722 tablet_bootstrap.cc:654] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.683835 17718 raft_consensus.cc:348] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.684065 17718 raft_consensus.cc:374] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.684154 17718 raft_consensus.cc:729] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.684371 17718 consensus_queue.cc:260] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.684850 17718 ts_tablet_manager.cc:1398] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:51.684877 17604 raft_consensus.cc:2454] T b5726229454f477d8e526198ede45aab P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:51.685144 17718 tablet_bootstrap.cc:492] T 4afbd55d9ebb4908adb04063270ddcba P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.686571 17718 tablet_bootstrap.cc:654] T 4afbd55d9ebb4908adb04063270ddcba P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.679322 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5726229454f477d8e526198ede45aab" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.687726 17603 raft_consensus.cc:2362] T b5726229454f477d8e526198ede45aab P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1. Re-sending same reply.
I20240503 08:12:51.676440 17782 leader_election.cc:288] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.666589 17678 raft_consensus.cc:2454] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:51.688966 17493 leader_election.cc:302] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.689327 17782 raft_consensus.cc:2781] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.689556 17782 raft_consensus.cc:686] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:51.689818 17782 consensus_queue.cc:237] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.691637 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "675688b228f147f8a88e69f43b91ef0c" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
W20240503 08:12:51.692286 17644 leader_election.cc:341] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.694803 17427 catalog_manager.cc:5484] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:51.695123 17426 catalog_manager.cc:5484] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:51.698246 17718 tablet_bootstrap.cc:492] T 4afbd55d9ebb4908adb04063270ddcba P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.698282 17719 tablet_bootstrap.cc:492] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.698407 17718 ts_tablet_manager.cc:1367] T 4afbd55d9ebb4908adb04063270ddcba P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20240503 08:12:51.698633 17719 ts_tablet_manager.cc:1367] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.004s
I20240503 08:12:51.699169 17718 raft_consensus.cc:348] T 4afbd55d9ebb4908adb04063270ddcba P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.699374 17718 raft_consensus.cc:374] T 4afbd55d9ebb4908adb04063270ddcba P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.699504 17718 raft_consensus.cc:729] T 4afbd55d9ebb4908adb04063270ddcba P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.699739 17719 raft_consensus.cc:348] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.699760 17718 consensus_queue.cc:260] T 4afbd55d9ebb4908adb04063270ddcba P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.700105 17719 raft_consensus.cc:374] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.700233 17719 raft_consensus.cc:729] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.700500 17718 ts_tablet_manager.cc:1398] T 4afbd55d9ebb4908adb04063270ddcba P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:51.700626 17719 consensus_queue.cc:260] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.700799 17718 tablet_bootstrap.cc:492] T f131aca1d2274b0ba4df3499cd835616 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.701278 17719 ts_tablet_manager.cc:1398] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.701659 17719 tablet_bootstrap.cc:492] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.701723 17729 leader_election.cc:288] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.703613 17719 tablet_bootstrap.cc:654] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.705726 17722 tablet_bootstrap.cc:492] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.705885 17722 ts_tablet_manager.cc:1367] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.015s
I20240503 08:12:51.706707 17722 raft_consensus.cc:348] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.706930 17722 raft_consensus.cc:374] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.707028 17722 raft_consensus.cc:729] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.707417 17718 tablet_bootstrap.cc:654] T f131aca1d2274b0ba4df3499cd835616 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.707315 17722 consensus_queue.cc:260] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.707846 17793 raft_consensus.cc:482] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.707981 17793 raft_consensus.cc:504] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.708618 17793 leader_election.cc:288] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.709348 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0faa2ea34146b48c0842a7878e20f3" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.709561 17678 raft_consensus.cc:2454] T cf0faa2ea34146b48c0842a7878e20f3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:51.709955 17568 leader_election.cc:302] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.710227 17793 raft_consensus.cc:2781] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.710346 17793 raft_consensus.cc:482] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.710446 17793 raft_consensus.cc:3037] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.710704 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0faa2ea34146b48c0842a7878e20f3" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.710886 17525 raft_consensus.cc:2454] T cf0faa2ea34146b48c0842a7878e20f3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:51.711022 17722 ts_tablet_manager.cc:1398] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20240503 08:12:51.711908 17426 catalog_manager.cc:5484] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:51.713847 17793 raft_consensus.cc:504] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.715024 17603 raft_consensus.cc:3037] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.715029 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0faa2ea34146b48c0842a7878e20f3" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.716236 17525 raft_consensus.cc:3037] T cf0faa2ea34146b48c0842a7878e20f3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.718634 17793 leader_election.cc:288] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.718680 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf0faa2ea34146b48c0842a7878e20f3" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.719154 17678 raft_consensus.cc:3037] T cf0faa2ea34146b48c0842a7878e20f3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.719483 17722 tablet_bootstrap.cc:492] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.719600 17525 raft_consensus.cc:2454] T cf0faa2ea34146b48c0842a7878e20f3 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.719887 17729 consensus_queue.cc:1035] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:51.721011 17567 leader_election.cc:302] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.721076 17718 tablet_bootstrap.cc:492] T f131aca1d2274b0ba4df3499cd835616 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.721298 17718 ts_tablet_manager.cc:1367] T f131aca1d2274b0ba4df3499cd835616 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20240503 08:12:51.721453 17793 raft_consensus.cc:2781] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.721530 17678 raft_consensus.cc:2454] T cf0faa2ea34146b48c0842a7878e20f3 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.721694 17793 raft_consensus.cc:686] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:51.722031 17793 consensus_queue.cc:237] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.722421 17718 raft_consensus.cc:348] T f131aca1d2274b0ba4df3499cd835616 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.722651 17718 raft_consensus.cc:374] T f131aca1d2274b0ba4df3499cd835616 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.722733 17718 raft_consensus.cc:729] T f131aca1d2274b0ba4df3499cd835616 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.723345 17718 consensus_queue.cc:260] T f131aca1d2274b0ba4df3499cd835616 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.724083 17718 ts_tablet_manager.cc:1398] T f131aca1d2274b0ba4df3499cd835616 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:12:51.724403 17718 tablet_bootstrap.cc:492] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.724645 17722 tablet_bootstrap.cc:654] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.726009 17718 tablet_bootstrap.cc:654] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.727394 17719 tablet_bootstrap.cc:492] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.727571 17719 ts_tablet_manager.cc:1367] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.011s
I20240503 08:12:51.728333 17719 raft_consensus.cc:348] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.728550 17719 raft_consensus.cc:374] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.728652 17719 raft_consensus.cc:729] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.728891 17719 consensus_queue.cc:260] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.729593 17719 ts_tablet_manager.cc:1398] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:51.729898 17719 tablet_bootstrap.cc:492] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.730020 17722 tablet_bootstrap.cc:492] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.730170 17722 ts_tablet_manager.cc:1367] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.003s
I20240503 08:12:51.731235 17722 raft_consensus.cc:348] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.731431 17722 raft_consensus.cc:374] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.731510 17722 raft_consensus.cc:729] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.731711 17722 consensus_queue.cc:260] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.731905 17719 tablet_bootstrap.cc:654] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.732154 17722 ts_tablet_manager.cc:1398] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:12:51.732529 17722 tablet_bootstrap.cc:492] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.733975 17722 tablet_bootstrap.cc:654] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.737717 17426 catalog_manager.cc:5484] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:51.744599 17744 consensus_queue.cc:1035] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:51.745375 17718 tablet_bootstrap.cc:492] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.745534 17718 ts_tablet_manager.cc:1367] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20240503 08:12:51.746295 17718 raft_consensus.cc:348] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.746497 17718 raft_consensus.cc:374] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.746588 17718 raft_consensus.cc:729] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.746855 17746 raft_consensus.cc:482] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.746812 17718 consensus_queue.cc:260] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.747001 17746 raft_consensus.cc:504] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.747357 17718 ts_tablet_manager.cc:1398] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:51.747695 17746 leader_election.cc:288] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.747915 17718 tablet_bootstrap.cc:492] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.748363 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4afbd55d9ebb4908adb04063270ddcba" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:51.749044 17644 leader_election.cc:341] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.749625 17718 tablet_bootstrap.cc:654] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.749903 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4afbd55d9ebb4908adb04063270ddcba" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.750123 17527 raft_consensus.cc:2454] T 4afbd55d9ebb4908adb04063270ddcba P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.750674 17641 leader_election.cc:302] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.751333 17744 consensus_queue.cc:1035] T 0eb6ec2d5ea544a3803f1f5e456901a3 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:51.753556 17744 raft_consensus.cc:2781] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.753675 17744 raft_consensus.cc:482] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.753793 17744 raft_consensus.cc:3037] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.755806 17718 tablet_bootstrap.cc:492] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.756079 17718 ts_tablet_manager.cc:1367] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20240503 08:12:51.756816 17744 raft_consensus.cc:504] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.756894 17718 raft_consensus.cc:348] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.757295 17718 raft_consensus.cc:374] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.757462 17718 raft_consensus.cc:729] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.757800 17718 consensus_queue.cc:260] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.758406 17718 ts_tablet_manager.cc:1398] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:51.758775 17718 tablet_bootstrap.cc:492] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.759311 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4afbd55d9ebb4908adb04063270ddcba" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.759570 17528 raft_consensus.cc:3037] T 4afbd55d9ebb4908adb04063270ddcba P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.760738 17718 tablet_bootstrap.cc:654] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.762240 17528 raft_consensus.cc:2454] T 4afbd55d9ebb4908adb04063270ddcba P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.762523 17719 tablet_bootstrap.cc:492] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.762694 17719 ts_tablet_manager.cc:1367] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.033s user 0.012s sys 0.019s
I20240503 08:12:51.762738 17641 leader_election.cc:302] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.762997 17746 raft_consensus.cc:2781] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.763479 17719 raft_consensus.cc:348] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.763710 17719 raft_consensus.cc:374] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.763790 17719 raft_consensus.cc:729] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.764082 17722 tablet_bootstrap.cc:492] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.764040 17719 consensus_queue.cc:260] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.764216 17722 ts_tablet_manager.cc:1367] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.032s user 0.009s sys 0.022s
I20240503 08:12:51.764564 17719 ts_tablet_manager.cc:1398] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:51.764840 17744 leader_election.cc:288] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.764977 17722 raft_consensus.cc:348] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.765161 17722 raft_consensus.cc:374] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.765256 17722 raft_consensus.cc:729] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.765338 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4afbd55d9ebb4908adb04063270ddcba" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.765473 17722 consensus_queue.cc:260] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.765655 17719 tablet_bootstrap.cc:492] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
W20240503 08:12:51.765830 17644 leader_election.cc:341] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.765931 17722 ts_tablet_manager.cc:1398] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:51.766834 17718 tablet_bootstrap.cc:492] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.766964 17718 ts_tablet_manager.cc:1367] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20240503 08:12:51.767535 17718 raft_consensus.cc:348] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.767681 17722 tablet_bootstrap.cc:492] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.768741 17719 tablet_bootstrap.cc:654] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.767726 17718 raft_consensus.cc:374] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.769371 17718 raft_consensus.cc:729] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.769861 17718 consensus_queue.cc:260] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.770409 17718 ts_tablet_manager.cc:1398] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:12:51.770632 17722 tablet_bootstrap.cc:654] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.770721 17718 tablet_bootstrap.cc:492] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.772362 17718 tablet_bootstrap.cc:654] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.780325 17746 raft_consensus.cc:686] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:51.780754 17746 consensus_queue.cc:237] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.783488 17793 raft_consensus.cc:482] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.783689 17793 raft_consensus.cc:504] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.784384 17793 leader_election.cc:288] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.785084 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "675688b228f147f8a88e69f43b91ef0c" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.786353 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "675688b228f147f8a88e69f43b91ef0c" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.786600 17528 raft_consensus.cc:2379] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69ebcf1734b949a19671e604e9a54cec in current term 1: Already voted for candidate 0d15e9450254455f8e3a1d2b194661a2 in this term.
I20240503 08:12:51.787004 17567 leader_election.cc:302] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2
I20240503 08:12:51.787475 17793 raft_consensus.cc:3037] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.790261 17793 raft_consensus.cc:2726] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.792745 17603 raft_consensus.cc:3037] T cf8db1fd73474fe2ad968e53f0ab71ae P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.795954 17782 raft_consensus.cc:482] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.796123 17782 raft_consensus.cc:504] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.796793 17782 leader_election.cc:288] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.796847 17729 consensus_queue.cc:1035] T cf8db1fd73474fe2ad968e53f0ab71ae P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:51.797163 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d620ba8c8c684a73af18b9fb62ea6113" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.797775 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d620ba8c8c684a73af18b9fb62ea6113" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:51.798389 17493 leader_election.cc:341] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
W20240503 08:12:51.798650 17495 leader_election.cc:341] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.798770 17495 leader_election.cc:302] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.799230 17790 raft_consensus.cc:2726] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.809298 17722 tablet_bootstrap.cc:492] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.809134 17427 catalog_manager.cc:5484] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:51.809548 17722 ts_tablet_manager.cc:1367] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.042s user 0.012s sys 0.016s
I20240503 08:12:51.809590 17719 tablet_bootstrap.cc:492] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.809762 17719 ts_tablet_manager.cc:1367] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.044s user 0.022s sys 0.016s
I20240503 08:12:51.810362 17719 raft_consensus.cc:348] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.810561 17719 raft_consensus.cc:374] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.810658 17719 raft_consensus.cc:729] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.810843 17718 tablet_bootstrap.cc:492] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.811003 17718 ts_tablet_manager.cc:1367] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.040s user 0.013s sys 0.018s
I20240503 08:12:51.810891 17719 consensus_queue.cc:260] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.811570 17719 ts_tablet_manager.cc:1398] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.811699 17718 raft_consensus.cc:348] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.811847 17719 tablet_bootstrap.cc:492] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.811899 17718 raft_consensus.cc:374] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.811976 17718 raft_consensus.cc:729] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.812191 17718 consensus_queue.cc:260] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.812800 17718 ts_tablet_manager.cc:1398] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:51.812803 17722 raft_consensus.cc:348] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.813159 17718 tablet_bootstrap.cc:492] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.813153 17722 raft_consensus.cc:374] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.813339 17722 raft_consensus.cc:729] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.813508 17719 tablet_bootstrap.cc:654] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.815292 17718 tablet_bootstrap.cc:654] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.817665 17719 tablet_bootstrap.cc:492] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.817818 17719 ts_tablet_manager.cc:1367] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20240503 08:12:51.818192 17722 consensus_queue.cc:260] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.818493 17719 raft_consensus.cc:348] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.818696 17719 raft_consensus.cc:374] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.818746 17722 ts_tablet_manager.cc:1398] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240503 08:12:51.818779 17719 raft_consensus.cc:729] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.818943 17718 tablet_bootstrap.cc:492] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.819027 17722 tablet_bootstrap.cc:492] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.819072 17718 ts_tablet_manager.cc:1367] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20240503 08:12:51.818997 17719 consensus_queue.cc:260] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.819767 17718 raft_consensus.cc:348] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.819959 17718 raft_consensus.cc:374] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.820061 17718 raft_consensus.cc:729] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.820327 17719 ts_tablet_manager.cc:1398] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.820282 17718 consensus_queue.cc:260] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.820602 17719 tablet_bootstrap.cc:492] T 4afbd55d9ebb4908adb04063270ddcba P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.820746 17722 tablet_bootstrap.cc:654] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.820768 17718 ts_tablet_manager.cc:1398] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:51.821020 17718 tablet_bootstrap.cc:492] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.822129 17719 tablet_bootstrap.cc:654] T 4afbd55d9ebb4908adb04063270ddcba P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.822520 17718 tablet_bootstrap.cc:654] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.828342 17746 raft_consensus.cc:482] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.828491 17746 raft_consensus.cc:504] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.829115 17746 leader_election.cc:288] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.829623 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6b261ca02d4cfe89b131c0ad46c8d2" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.829821 17603 raft_consensus.cc:2454] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.830464 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6b261ca02d4cfe89b131c0ad46c8d2" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.830693 17527 raft_consensus.cc:2454] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.830865 17644 leader_election.cc:302] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.831233 17746 raft_consensus.cc:2781] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.831383 17746 raft_consensus.cc:482] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.831506 17746 raft_consensus.cc:3037] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.832367 17718 tablet_bootstrap.cc:492] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.832389 17719 tablet_bootstrap.cc:492] T 4afbd55d9ebb4908adb04063270ddcba P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.832568 17719 ts_tablet_manager.cc:1367] T 4afbd55d9ebb4908adb04063270ddcba P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.011s
I20240503 08:12:51.832572 17718 ts_tablet_manager.cc:1367] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20240503 08:12:51.833359 17718 raft_consensus.cc:348] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.833388 17719 raft_consensus.cc:348] T 4afbd55d9ebb4908adb04063270ddcba P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.833432 17746 raft_consensus.cc:504] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.833606 17719 raft_consensus.cc:374] T 4afbd55d9ebb4908adb04063270ddcba P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.833603 17718 raft_consensus.cc:374] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.833734 17718 raft_consensus.cc:729] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.833745 17719 raft_consensus.cc:729] T 4afbd55d9ebb4908adb04063270ddcba P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.833995 17719 consensus_queue.cc:260] T 4afbd55d9ebb4908adb04063270ddcba P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.834313 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6b261ca02d4cfe89b131c0ad46c8d2" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.834507 17527 raft_consensus.cc:3037] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.834563 17719 ts_tablet_manager.cc:1398] T 4afbd55d9ebb4908adb04063270ddcba P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:12:51.834697 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc6b261ca02d4cfe89b131c0ad46c8d2" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.834846 17603 raft_consensus.cc:3037] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.834939 17719 tablet_bootstrap.cc:492] T c48f27bec58e44308b20007f7ae59c82 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.836660 17719 tablet_bootstrap.cc:654] T c48f27bec58e44308b20007f7ae59c82 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.837405 17527 raft_consensus.cc:2454] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.837456 17746 leader_election.cc:288] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.837406 17603 raft_consensus.cc:2454] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.837808 17793 raft_consensus.cc:482] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.837862 17644 leader_election.cc:302] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.837939 17793 raft_consensus.cc:504] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.838155 17746 raft_consensus.cc:2781] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.838290 17746 raft_consensus.cc:686] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:51.838541 17793 leader_election.cc:288] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.839097 17722 tablet_bootstrap.cc:492] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.839236 17722 ts_tablet_manager.cc:1367] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.000s
I20240503 08:12:51.833997 17718 consensus_queue.cc:260] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.839560 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01c1231eca744af282822464f9af362e" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.839732 17528 raft_consensus.cc:2454] T 01c1231eca744af282822464f9af362e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:51.840011 17722 raft_consensus.cc:348] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.840101 17567 leader_election.cc:302] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.840201 17722 raft_consensus.cc:374] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.840292 17722 raft_consensus.cc:729] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.840561 17718 ts_tablet_manager.cc:1398] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20240503 08:12:51.840494 17722 consensus_queue.cc:260] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.840785 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01c1231eca744af282822464f9af362e" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.840886 17718 tablet_bootstrap.cc:492] T 930776b028d34183b0aee54f1cc5d98d P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.840986 17722 ts_tablet_manager.cc:1398] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:51.840961 17678 raft_consensus.cc:2454] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:51.841446 17722 tablet_bootstrap.cc:492] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.841840 17793 raft_consensus.cc:2781] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.841956 17793 raft_consensus.cc:482] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.842046 17793 raft_consensus.cc:3037] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.842864 17718 tablet_bootstrap.cc:654] T 930776b028d34183b0aee54f1cc5d98d P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.843924 17722 tablet_bootstrap.cc:654] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.844600 17746 consensus_queue.cc:237] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.846550 17793 raft_consensus.cc:504] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.847566 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01c1231eca744af282822464f9af362e" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.847769 17527 raft_consensus.cc:3037] T 01c1231eca744af282822464f9af362e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.850652 17527 raft_consensus.cc:2454] T 01c1231eca744af282822464f9af362e P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.851068 17567 leader_election.cc:302] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.851397 17786 raft_consensus.cc:2781] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.851568 17786 raft_consensus.cc:686] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:51.851840 17786 consensus_queue.cc:237] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.852524 17782 raft_consensus.cc:482] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.852684 17782 raft_consensus.cc:504] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.853266 17782 leader_election.cc:288] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.853932 17793 leader_election.cc:288] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.854058 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "979822ec7a3842248c37ee6ec6bf618c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.854243 17678 raft_consensus.cc:2454] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:51.854511 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01c1231eca744af282822464f9af362e" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.854708 17677 raft_consensus.cc:3037] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.855711 17722 tablet_bootstrap.cc:492] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.855868 17722 ts_tablet_manager.cc:1367] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.003s
I20240503 08:12:51.856545 17722 raft_consensus.cc:348] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.856734 17722 raft_consensus.cc:374] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.856799 17722 raft_consensus.cc:729] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.857030 17722 consensus_queue.cc:260] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.857192 17677 raft_consensus.cc:2454] T 01c1231eca744af282822464f9af362e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.857631 17722 ts_tablet_manager.cc:1398] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:51.857694 17493 leader_election.cc:302] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.857921 17722 tablet_bootstrap.cc:492] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.858422 17782 raft_consensus.cc:2781] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.858518 17782 raft_consensus.cc:482] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.858630 17782 raft_consensus.cc:3037] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.859035 17719 tablet_bootstrap.cc:492] T c48f27bec58e44308b20007f7ae59c82 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.859194 17719 ts_tablet_manager.cc:1367] T c48f27bec58e44308b20007f7ae59c82 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.015s
I20240503 08:12:51.859549 17722 tablet_bootstrap.cc:654] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.860011 17719 raft_consensus.cc:348] T c48f27bec58e44308b20007f7ae59c82 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.860247 17719 raft_consensus.cc:374] T c48f27bec58e44308b20007f7ae59c82 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.860324 17719 raft_consensus.cc:729] T c48f27bec58e44308b20007f7ae59c82 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.860577 17719 consensus_queue.cc:260] T c48f27bec58e44308b20007f7ae59c82 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.861057 17719 ts_tablet_manager.cc:1398] T c48f27bec58e44308b20007f7ae59c82 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:12:51.861359 17719 tablet_bootstrap.cc:492] T d620ba8c8c684a73af18b9fb62ea6113 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.861366 17782 raft_consensus.cc:504] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.862305 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "979822ec7a3842248c37ee6ec6bf618c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.862576 17832 consensus_queue.cc:1035] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:51.863216 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "979822ec7a3842248c37ee6ec6bf618c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.863691 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "979822ec7a3842248c37ee6ec6bf618c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.863849 17719 tablet_bootstrap.cc:654] T d620ba8c8c684a73af18b9fb62ea6113 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.863855 17677 raft_consensus.cc:3037] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.865799 17782 leader_election.cc:288] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.867084 17427 catalog_manager.cc:5484] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:51.867938 17677 raft_consensus.cc:2454] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:51.868397 17493 leader_election.cc:302] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.868850 17782 raft_consensus.cc:2781] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.869199 17782 raft_consensus.cc:686] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:51.869515 17782 consensus_queue.cc:237] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.862212 17793 raft_consensus.cc:482] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.870615 17793 raft_consensus.cc:504] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.871001 17603 raft_consensus.cc:2454] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:51.872047 17722 tablet_bootstrap.cc:492] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.872212 17722 ts_tablet_manager.cc:1367] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.007s
I20240503 08:12:51.872381 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "979822ec7a3842248c37ee6ec6bf618c" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.872932 17722 raft_consensus.cc:348] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.873272 17722 raft_consensus.cc:374] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.873373 17722 raft_consensus.cc:729] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.873589 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "979822ec7a3842248c37ee6ec6bf618c" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.873878 17677 raft_consensus.cc:2379] T 979822ec7a3842248c37ee6ec6bf618c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69ebcf1734b949a19671e604e9a54cec in current term 1: Already voted for candidate 06335016e7f84df18efcdfacbab289b2 in this term.
I20240503 08:12:51.874163 17832 raft_consensus.cc:482] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.874336 17568 leader_election.cc:302] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2
I20240503 08:12:51.874312 17832 raft_consensus.cc:504] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.874684 17786 raft_consensus.cc:3037] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.874802 17718 tablet_bootstrap.cc:492] T 930776b028d34183b0aee54f1cc5d98d P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:51.874884 17832 leader_election.cc:288] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.874954 17718 ts_tablet_manager.cc:1367] T 930776b028d34183b0aee54f1cc5d98d P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.002s
I20240503 08:12:51.875478 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930776b028d34183b0aee54f1cc5d98d" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.875775 17718 raft_consensus.cc:348] T 930776b028d34183b0aee54f1cc5d98d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.875985 17718 raft_consensus.cc:374] T 930776b028d34183b0aee54f1cc5d98d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.875957 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930776b028d34183b0aee54f1cc5d98d" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
W20240503 08:12:51.876065 17644 leader_election.cc:341] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.876091 17718 raft_consensus.cc:729] T 930776b028d34183b0aee54f1cc5d98d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.874003 17722 consensus_queue.cc:260] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.876358 17718 consensus_queue.cc:260] T 930776b028d34183b0aee54f1cc5d98d P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.876721 17528 raft_consensus.cc:2454] T 930776b028d34183b0aee54f1cc5d98d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.877246 17722 ts_tablet_manager.cc:1398] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240503 08:12:51.877318 17641 leader_election.cc:302] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.877533 17722 tablet_bootstrap.cc:492] T c48f27bec58e44308b20007f7ae59c82 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.877763 17832 raft_consensus.cc:2781] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.877869 17832 raft_consensus.cc:482] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.877981 17832 raft_consensus.cc:3037] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.878803 17786 raft_consensus.cc:2726] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.874007 17793 leader_election.cc:288] T 979822ec7a3842248c37ee6ec6bf618c P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.879185 17722 tablet_bootstrap.cc:654] T c48f27bec58e44308b20007f7ae59c82 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.880877 17832 raft_consensus.cc:504] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.881399 17427 catalog_manager.cc:5484] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:51.881774 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930776b028d34183b0aee54f1cc5d98d" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.881958 17528 raft_consensus.cc:3037] T 930776b028d34183b0aee54f1cc5d98d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.884713 17528 raft_consensus.cc:2454] T 930776b028d34183b0aee54f1cc5d98d P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.888433 17641 leader_election.cc:302] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.888763 17746 raft_consensus.cc:2781] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.888989 17746 raft_consensus.cc:686] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:51.889281 17746 consensus_queue.cc:237] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.890381 17744 raft_consensus.cc:482] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.890561 17744 raft_consensus.cc:504] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.891185 17744 leader_election.cc:288] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.891532 17427 catalog_manager.cc:5484] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:51.891752 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d90423110fd4c65af6911bc983a9d57" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.892045 17782 consensus_queue.cc:1035] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 08:12:51.892304 17644 leader_election.cc:341] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.894028 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d90423110fd4c65af6911bc983a9d57" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.894237 17527 raft_consensus.cc:2454] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:51.895380 17744 consensus_queue.cc:1035] T 5e5a4235b0d0427cb308ae894cb0b00a P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:51.895527 17641 leader_election.cc:302] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.895807 17744 raft_consensus.cc:2781] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.895929 17744 raft_consensus.cc:482] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.896023 17744 raft_consensus.cc:3037] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.896955 17832 leader_election.cc:288] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.897989 17718 ts_tablet_manager.cc:1398] T 930776b028d34183b0aee54f1cc5d98d P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.023s user 0.003s sys 0.000s
I20240503 08:12:51.898285 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "930776b028d34183b0aee54f1cc5d98d" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
W20240503 08:12:51.898784 17644 leader_election.cc:341] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.898283 17718 tablet_bootstrap.cc:492] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:51.902057 17427 catalog_manager.cc:5484] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:51.908574 17719 tablet_bootstrap.cc:492] T d620ba8c8c684a73af18b9fb62ea6113 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:51.908598 17722 tablet_bootstrap.cc:492] T c48f27bec58e44308b20007f7ae59c82 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:51.908735 17719 ts_tablet_manager.cc:1367] T d620ba8c8c684a73af18b9fb62ea6113 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.047s user 0.009s sys 0.026s
I20240503 08:12:51.908742 17722 ts_tablet_manager.cc:1367] T c48f27bec58e44308b20007f7ae59c82 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
I20240503 08:12:51.909385 17719 raft_consensus.cc:348] T d620ba8c8c684a73af18b9fb62ea6113 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.909587 17719 raft_consensus.cc:374] T d620ba8c8c684a73af18b9fb62ea6113 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.909633 17719 raft_consensus.cc:729] T d620ba8c8c684a73af18b9fb62ea6113 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.909385 17722 raft_consensus.cc:348] T c48f27bec58e44308b20007f7ae59c82 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.909742 17722 raft_consensus.cc:374] T c48f27bec58e44308b20007f7ae59c82 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:51.909703 17744 raft_consensus.cc:504] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.909796 17722 raft_consensus.cc:729] T c48f27bec58e44308b20007f7ae59c82 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:51.909792 17719 consensus_queue.cc:260] T d620ba8c8c684a73af18b9fb62ea6113 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.909979 17722 consensus_queue.cc:260] T c48f27bec58e44308b20007f7ae59c82 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.910256 17744 leader_election.cc:288] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.910280 17719 ts_tablet_manager.cc:1398] T d620ba8c8c684a73af18b9fb62ea6113 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240503 08:12:51.910449 17722 ts_tablet_manager.cc:1398] T c48f27bec58e44308b20007f7ae59c82 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:51.910543 17719 tablet_bootstrap.cc:492] T 4d14d9f86bea4e43a160d30bed9a6a30 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:51.910645 17722 tablet_bootstrap.cc:492] T 4d14d9f86bea4e43a160d30bed9a6a30 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:51.911648 17790 consensus_queue.cc:1035] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:51.911868 17719 tablet_bootstrap.cc:654] T 4d14d9f86bea4e43a160d30bed9a6a30 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.912456 17793 consensus_queue.cc:1035] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:51.912859 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d90423110fd4c65af6911bc983a9d57" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.911868 17722 tablet_bootstrap.cc:654] T 4d14d9f86bea4e43a160d30bed9a6a30 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
W20240503 08:12:51.915385 17644 leader_election.cc:341] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.916568 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d90423110fd4c65af6911bc983a9d57" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.916707 17528 raft_consensus.cc:3037] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.916391 17746 consensus_queue.cc:1035] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:51.918143 17746 consensus_queue.cc:1035] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:51.919189 17528 raft_consensus.cc:2454] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:51.919510 17641 leader_election.cc:302] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.919924 17729 raft_consensus.cc:2781] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.920019 17729 raft_consensus.cc:686] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:51.920240 17729 consensus_queue.cc:237] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.928254 17790 raft_consensus.cc:482] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.928402 17790 raft_consensus.cc:504] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.928982 17790 leader_election.cc:288] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.929529 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f95209235434aa0aa22bb6fff89bbb5" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.929699 17678 raft_consensus.cc:2454] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:51.930080 17493 leader_election.cc:302] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.930317 17790 raft_consensus.cc:2781] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.930392 17790 raft_consensus.cc:482] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.930454 17790 raft_consensus.cc:3037] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.933277 17790 raft_consensus.cc:504] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.934276 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f95209235434aa0aa22bb6fff89bbb5" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.934448 17678 raft_consensus.cc:3037] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.938555 17678 raft_consensus.cc:2454] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:51.938984 17493 leader_election.cc:302] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:51.939276 17724 raft_consensus.cc:2781] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.939393 17724 raft_consensus.cc:686] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:51.939666 17724 consensus_queue.cc:237] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.941226 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f95209235434aa0aa22bb6fff89bbb5" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.941398 17604 raft_consensus.cc:2454] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:51.941679 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f95209235434aa0aa22bb6fff89bbb5" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:51.941807 17602 raft_consensus.cc:3037] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.942116 17790 leader_election.cc:288] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.944516 17602 raft_consensus.cc:2454] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:51.944756 17793 raft_consensus.cc:482] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.944859 17793 raft_consensus.cc:504] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.945422 17793 leader_election.cc:288] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.946797 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd9674d047e34552a9142e4df2147730" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.946959 17528 raft_consensus.cc:2454] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:51.947355 17567 leader_election.cc:302] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.947676 17793 raft_consensus.cc:2781] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.947743 17793 raft_consensus.cc:482] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.947795 17793 raft_consensus.cc:3037] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.949288 17790 raft_consensus.cc:482] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.949402 17790 raft_consensus.cc:504] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.950235 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "948437c8a338413c9b744147f6a8a5bd" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.950271 17793 raft_consensus.cc:504] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
W20240503 08:12:51.950743 17493 leader_election.cc:341] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.950881 17790 leader_election.cc:288] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.951184 17793 leader_election.cc:288] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.951375 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd9674d047e34552a9142e4df2147730" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.951543 17676 raft_consensus.cc:3037] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.951912 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd9674d047e34552a9142e4df2147730" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.952040 17528 raft_consensus.cc:3037] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.954042 17676 raft_consensus.cc:2454] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.954492 17568 leader_election.cc:302] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.954730 17793 raft_consensus.cc:2781] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.954761 17528 raft_consensus.cc:2454] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.954916 17793 raft_consensus.cc:686] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:51.955142 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "948437c8a338413c9b744147f6a8a5bd" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:51.955279 17793 consensus_queue.cc:237] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.955585 17832 raft_consensus.cc:482] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.955678 17832 raft_consensus.cc:504] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.956303 17832 leader_election.cc:288] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:51.958010 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abd9d58bdf05436195bd0afcca4c00d3" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:51.958469 17644 leader_election.cc:341] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.958688 17832 consensus_queue.cc:1035] T b0dd68775f514b6b983f28fd87d9e4ec P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 08:12:51.959617 17495 leader_election.cc:341] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.959970 17495 leader_election.cc:302] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.961071 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd9674d047e34552a9142e4df2147730" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.961299 17678 raft_consensus.cc:2362] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1. Re-sending same reply.
I20240503 08:12:51.961616 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abd9d58bdf05436195bd0afcca4c00d3" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.961915 17786 raft_consensus.cc:482] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:51.962030 17786 raft_consensus.cc:504] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
W20240503 08:12:51.962142 17641 leader_election.cc:341] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:51.962219 17641 leader_election.cc:302] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2; no voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:51.962558 17786 leader_election.cc:288] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.962605 17856 raft_consensus.cc:2726] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.963042 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f131aca1d2274b0ba4df3499cd835616" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:51.963210 17678 raft_consensus.cc:2454] T f131aca1d2274b0ba4df3499cd835616 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:51.963042 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f131aca1d2274b0ba4df3499cd835616" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:51.963513 17528 raft_consensus.cc:2454] T f131aca1d2274b0ba4df3499cd835616 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:51.963558 17568 leader_election.cc:302] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.963762 17786 raft_consensus.cc:2781] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:51.963830 17786 raft_consensus.cc:482] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:51.963887 17786 raft_consensus.cc:3037] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.963091 17790 raft_consensus.cc:2726] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:51.966559 17786 raft_consensus.cc:504] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.967075 17786 leader_election.cc:288] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:51.967553 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f131aca1d2274b0ba4df3499cd835616" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:51.967689 17678 raft_consensus.cc:3037] T f131aca1d2274b0ba4df3499cd835616 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.967979 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f131aca1d2274b0ba4df3499cd835616" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:51.968214 17528 raft_consensus.cc:3037] T f131aca1d2274b0ba4df3499cd835616 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:51.970139 17678 raft_consensus.cc:2454] T f131aca1d2274b0ba4df3499cd835616 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.970458 17568 leader_election.cc:302] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:51.970706 17786 raft_consensus.cc:2781] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:51.970868 17786 raft_consensus.cc:686] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:51.971125 17786 consensus_queue.cc:237] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:51.971557 17528 raft_consensus.cc:2454] T f131aca1d2274b0ba4df3499cd835616 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:51.974572 17856 consensus_queue.cc:1035] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:51.981804 17718 tablet_bootstrap.cc:654] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:51.991158 17723 consensus_queue.cc:1035] T 2ee11da8ed904a74b46369a40ba83af8 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.000118 17528 raft_consensus.cc:3037] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.004103 17719 tablet_bootstrap.cc:492] T 4d14d9f86bea4e43a160d30bed9a6a30 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.004254 17719 ts_tablet_manager.cc:1367] T 4d14d9f86bea4e43a160d30bed9a6a30 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.094s user 0.038s sys 0.043s
I20240503 08:12:52.004065 17427 catalog_manager.cc:5484] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:52.004940 17719 raft_consensus.cc:348] T 4d14d9f86bea4e43a160d30bed9a6a30 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.005105 17719 raft_consensus.cc:374] T 4d14d9f86bea4e43a160d30bed9a6a30 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.005149 17719 raft_consensus.cc:729] T 4d14d9f86bea4e43a160d30bed9a6a30 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.005374 17719 consensus_queue.cc:260] T 4d14d9f86bea4e43a160d30bed9a6a30 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.005851 17719 ts_tablet_manager.cc:1398] T 4d14d9f86bea4e43a160d30bed9a6a30 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:52.006101 17719 tablet_bootstrap.cc:492] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.010423 17746 consensus_queue.cc:1035] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.010778 17719 tablet_bootstrap.cc:654] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.012742 17746 consensus_queue.cc:1035] T f2057a35eb684e41bac23078e6526b08 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.016080 17719 tablet_bootstrap.cc:492] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.016220 17719 ts_tablet_manager.cc:1367] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.001s
I20240503 08:12:52.017103 17719 raft_consensus.cc:348] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.017288 17719 raft_consensus.cc:374] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.017351 17719 raft_consensus.cc:729] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.017566 17719 consensus_queue.cc:260] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.017832 17426 catalog_manager.cc:5484] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.018203 17719 ts_tablet_manager.cc:1398] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:12:52.018962 17719 tablet_bootstrap.cc:492] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.019641 17718 tablet_bootstrap.cc:492] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.019804 17718 ts_tablet_manager.cc:1367] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.122s user 0.013s sys 0.000s
I20240503 08:12:52.020599 17719 tablet_bootstrap.cc:654] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.020476 17718 raft_consensus.cc:348] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.021369 17718 raft_consensus.cc:374] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.021488 17718 raft_consensus.cc:729] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.021754 17718 consensus_queue.cc:260] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.022447 17718 ts_tablet_manager.cc:1398] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:52.022818 17718 tablet_bootstrap.cc:492] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.024287 17718 tablet_bootstrap.cc:654] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.025274 17722 tablet_bootstrap.cc:492] T 4d14d9f86bea4e43a160d30bed9a6a30 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.025431 17722 ts_tablet_manager.cc:1367] T 4d14d9f86bea4e43a160d30bed9a6a30 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.115s user 0.023s sys 0.032s
I20240503 08:12:52.026238 17722 raft_consensus.cc:348] T 4d14d9f86bea4e43a160d30bed9a6a30 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.026449 17722 raft_consensus.cc:374] T 4d14d9f86bea4e43a160d30bed9a6a30 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.026546 17722 raft_consensus.cc:729] T 4d14d9f86bea4e43a160d30bed9a6a30 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.026822 17722 consensus_queue.cc:260] T 4d14d9f86bea4e43a160d30bed9a6a30 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.027462 17722 ts_tablet_manager.cc:1398] T 4d14d9f86bea4e43a160d30bed9a6a30 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:52.027746 17722 tablet_bootstrap.cc:492] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.028410 17426 catalog_manager.cc:5484] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.029129 17722 tablet_bootstrap.cc:654] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.030866 17719 tablet_bootstrap.cc:492] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.031034 17719 ts_tablet_manager.cc:1367] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.001s
I20240503 08:12:52.031033 17722 tablet_bootstrap.cc:492] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.031230 17722 ts_tablet_manager.cc:1367] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240503 08:12:52.031701 17719 raft_consensus.cc:348] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.031760 17722 raft_consensus.cc:348] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.031944 17719 raft_consensus.cc:374] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.031971 17722 raft_consensus.cc:374] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.032043 17719 raft_consensus.cc:729] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.032047 17722 raft_consensus.cc:729] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.032291 17719 consensus_queue.cc:260] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.032750 17718 tablet_bootstrap.cc:492] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.032559 17425 catalog_manager.cc:5484] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.032912 17718 ts_tablet_manager.cc:1367] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20240503 08:12:52.033015 17722 consensus_queue.cc:260] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.032934 17719 ts_tablet_manager.cc:1398] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:52.033500 17722 ts_tablet_manager.cc:1398] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:52.033699 17718 raft_consensus.cc:348] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.033829 17722 tablet_bootstrap.cc:492] T 948437c8a338413c9b744147f6a8a5bd P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.033898 17718 raft_consensus.cc:374] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.033968 17718 raft_consensus.cc:729] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.034216 17718 consensus_queue.cc:260] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.034669 17718 ts_tablet_manager.cc:1398] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:52.034938 17718 tablet_bootstrap.cc:492] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.035162 17724 raft_consensus.cc:482] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.035281 17722 tablet_bootstrap.cc:654] T 948437c8a338413c9b744147f6a8a5bd P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.035300 17724 raft_consensus.cc:504] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.036007 17724 leader_election.cc:288] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.036221 17718 tablet_bootstrap.cc:654] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.036566 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7bdb7ab18e84803ae008edf16ca9d4f" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
W20240503 08:12:52.037089 17493 leader_election.cc:341] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.037338 17724 raft_consensus.cc:482] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.037501 17724 raft_consensus.cc:504] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.037966 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7bdb7ab18e84803ae008edf16ca9d4f" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.038082 17724 leader_election.cc:288] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
W20240503 08:12:52.038410 17495 leader_election.cc:341] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.038533 17495 leader_election.cc:302] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.038596 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d14d9f86bea4e43a160d30bed9a6a30" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.038774 17724 raft_consensus.cc:2726] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.038801 17602 raft_consensus.cc:2454] T 4d14d9f86bea4e43a160d30bed9a6a30 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.039178 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d14d9f86bea4e43a160d30bed9a6a30" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.039368 17677 raft_consensus.cc:2454] T 4d14d9f86bea4e43a160d30bed9a6a30 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.039588 17495 leader_election.cc:302] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.038089 17719 tablet_bootstrap.cc:492] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.041395 17724 raft_consensus.cc:2781] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.042037 17724 raft_consensus.cc:482] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.042176 17744 consensus_queue.cc:1035] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.042835 17719 tablet_bootstrap.cc:654] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.043821 17744 consensus_queue.cc:1035] T 761ee807456f4691bb8ae39350bff31c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240503 08:12:52.044328 17724 raft_consensus.cc:3037] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.051599 17724 raft_consensus.cc:504] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.052589 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d14d9f86bea4e43a160d30bed9a6a30" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.052789 17604 raft_consensus.cc:3037] T 4d14d9f86bea4e43a160d30bed9a6a30 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.055285 17718 tablet_bootstrap.cc:492] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.055469 17718 ts_tablet_manager.cc:1367] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.006s
I20240503 08:12:52.055541 17604 raft_consensus.cc:2454] T 4d14d9f86bea4e43a160d30bed9a6a30 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.055963 17495 leader_election.cc:302] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.057318 17718 raft_consensus.cc:348] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.057541 17786 consensus_queue.cc:1035] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.059528 17790 raft_consensus.cc:2781] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.059574 17724 leader_election.cc:288] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.059688 17790 raft_consensus.cc:686] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:52.059665 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d14d9f86bea4e43a160d30bed9a6a30" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.059826 17678 raft_consensus.cc:3037] T 4d14d9f86bea4e43a160d30bed9a6a30 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.059935 17790 consensus_queue.cc:237] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.062283 17678 raft_consensus.cc:2454] T 4d14d9f86bea4e43a160d30bed9a6a30 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.057538 17718 raft_consensus.cc:374] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.067070 17718 raft_consensus.cc:729] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.067612 17718 consensus_queue.cc:260] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.069187 17722 tablet_bootstrap.cc:492] T 948437c8a338413c9b744147f6a8a5bd P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.070070 17722 ts_tablet_manager.cc:1367] T 948437c8a338413c9b744147f6a8a5bd P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.015s
I20240503 08:12:52.071385 17718 ts_tablet_manager.cc:1398] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20240503 08:12:52.071813 17729 raft_consensus.cc:482] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.071975 17729 raft_consensus.cc:504] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.072115 17722 raft_consensus.cc:348] T 948437c8a338413c9b744147f6a8a5bd P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.072616 17722 raft_consensus.cc:374] T 948437c8a338413c9b744147f6a8a5bd P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.072866 17722 raft_consensus.cc:729] T 948437c8a338413c9b744147f6a8a5bd P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.072646 17729 leader_election.cc:288] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.073067 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e346620585b34fafac5e29522169927a" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.073103 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e346620585b34fafac5e29522169927a" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
W20240503 08:12:52.073603 17641 leader_election.cc:341] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): Illegal state: must be running to vote when last-logged opid is not known
W20240503 08:12:52.073774 17644 leader_election.cc:341] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.074352 17718 tablet_bootstrap.cc:492] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.076365 17644 leader_election.cc:302] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2; no voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.077277 17722 consensus_queue.cc:260] T 948437c8a338413c9b744147f6a8a5bd P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.077500 17729 raft_consensus.cc:2726] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.078716 17718 tablet_bootstrap.cc:654] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.079202 17427 catalog_manager.cc:5484] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.079993 17719 tablet_bootstrap.cc:492] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.080154 17719 ts_tablet_manager.cc:1367] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.042s user 0.012s sys 0.014s
I20240503 08:12:52.080845 17719 raft_consensus.cc:348] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.081039 17719 raft_consensus.cc:374] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.081137 17719 raft_consensus.cc:729] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.081394 17719 consensus_queue.cc:260] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.082799 17719 ts_tablet_manager.cc:1398] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:12:52.083092 17719 tablet_bootstrap.cc:492] T a2f9b49da78f44acb5a4f554eef1ead7 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.083137 17722 ts_tablet_manager.cc:1398] T 948437c8a338413c9b744147f6a8a5bd P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20240503 08:12:52.083531 17722 tablet_bootstrap.cc:492] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.084620 17719 tablet_bootstrap.cc:654] T a2f9b49da78f44acb5a4f554eef1ead7 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.084893 17722 tablet_bootstrap.cc:654] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.086953 17785 consensus_queue.cc:1035] T aee53c998fb44359b24cb8bf1e9ae658 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.088244 17782 consensus_queue.cc:1035] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.091796 17785 raft_consensus.cc:482] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.091970 17785 raft_consensus.cc:504] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.092666 17785 leader_election.cc:288] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.093564 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "948437c8a338413c9b744147f6a8a5bd" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.093777 17523 raft_consensus.cc:2454] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:52.094135 17567 leader_election.cc:302] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.094252 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "948437c8a338413c9b744147f6a8a5bd" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.094431 17785 raft_consensus.cc:2781] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.094475 17677 raft_consensus.cc:2454] T 948437c8a338413c9b744147f6a8a5bd P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:52.094556 17785 raft_consensus.cc:482] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.094663 17785 raft_consensus.cc:3037] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.094988 17782 consensus_queue.cc:1035] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.097470 17785 raft_consensus.cc:504] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.098397 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "948437c8a338413c9b744147f6a8a5bd" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:52.098598 17523 raft_consensus.cc:3037] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.099434 17746 consensus_queue.cc:1035] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.101421 17523 raft_consensus.cc:2454] T 948437c8a338413c9b744147f6a8a5bd P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:52.101840 17567 leader_election.cc:302] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.102087 17723 raft_consensus.cc:2781] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.102263 17723 raft_consensus.cc:686] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:52.102350 17785 leader_election.cc:288] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.102541 17723 consensus_queue.cc:237] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.104115 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "948437c8a338413c9b744147f6a8a5bd" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.104296 17676 raft_consensus.cc:3037] T 948437c8a338413c9b744147f6a8a5bd P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.107082 17676 raft_consensus.cc:2454] T 948437c8a338413c9b744147f6a8a5bd P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:52.111765 17782 consensus_queue.cc:1035] T b5726229454f477d8e526198ede45aab P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.113235 17718 tablet_bootstrap.cc:492] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.113430 17718 ts_tablet_manager.cc:1367] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.013s
I20240503 08:12:52.114091 17718 raft_consensus.cc:348] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.114311 17718 raft_consensus.cc:374] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.114401 17718 raft_consensus.cc:729] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.114631 17718 consensus_queue.cc:260] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.115161 17718 ts_tablet_manager.cc:1398] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:12:52.115509 17718 tablet_bootstrap.cc:492] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.116922 17718 tablet_bootstrap.cc:654] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.116873 17782 consensus_queue.cc:1035] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.119884 17782 raft_consensus.cc:482] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.120062 17782 raft_consensus.cc:504] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.120904 17782 leader_election.cc:288] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.120975 17722 tablet_bootstrap.cc:492] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.121263 17722 ts_tablet_manager.cc:1367] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.038s user 0.015s sys 0.019s
I20240503 08:12:52.121670 17674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c48f27bec58e44308b20007f7ae59c82" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.121917 17674 raft_consensus.cc:2454] T c48f27bec58e44308b20007f7ae59c82 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.122078 17722 raft_consensus.cc:348] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.122363 17722 raft_consensus.cc:374] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.122416 17493 leader_election.cc:302] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.122485 17722 raft_consensus.cc:729] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.122817 17722 consensus_queue.cc:260] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.123422 17722 ts_tablet_manager.cc:1398] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:52.126170 17722 tablet_bootstrap.cc:492] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.127163 17793 raft_consensus.cc:482] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.127475 17793 raft_consensus.cc:504] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.124126 17746 raft_consensus.cc:482] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.128826 17793 leader_election.cc:288] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.128858 17746 raft_consensus.cc:504] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.129424 17746 leader_election.cc:288] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.129916 17782 raft_consensus.cc:2781] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.130738 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d90423110fd4c65af6911bc983a9d57" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.130962 17523 raft_consensus.cc:2379] T 8d90423110fd4c65af6911bc983a9d57 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69ebcf1734b949a19671e604e9a54cec in current term 1: Already voted for candidate 0d15e9450254455f8e3a1d2b194661a2 in this term.
I20240503 08:12:52.130720 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f9b49da78f44acb5a4f554eef1ead7" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.137785 17790 raft_consensus.cc:482] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.138022 17790 raft_consensus.cc:504] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.138801 17746 consensus_queue.cc:1035] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20240503 08:12:52.139142 17782 raft_consensus.cc:482] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.150158 17722 tablet_bootstrap.cc:654] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.166971 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d90423110fd4c65af6911bc983a9d57" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.167914 17568 leader_election.cc:302] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2
I20240503 08:12:52.168725 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c48f27bec58e44308b20007f7ae59c82" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.170918 17790 leader_election.cc:288] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.173440 17527 raft_consensus.cc:2454] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:52.174731 17427 catalog_manager.cc:5484] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.177405 17782 raft_consensus.cc:3037] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.178104 17793 raft_consensus.cc:3037] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.180794 17793 raft_consensus.cc:2726] T 8d90423110fd4c65af6911bc983a9d57 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.182291 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f9b49da78f44acb5a4f554eef1ead7" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.183687 17641 leader_election.cc:302] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.184084 17746 raft_consensus.cc:2781] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.184221 17746 raft_consensus.cc:482] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.184312 17746 raft_consensus.cc:3037] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.186333 17718 tablet_bootstrap.cc:492] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.186501 17718 ts_tablet_manager.cc:1367] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.071s user 0.010s sys 0.018s
I20240503 08:12:52.186560 17722 tablet_bootstrap.cc:492] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.186698 17722 ts_tablet_manager.cc:1367] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.061s user 0.005s sys 0.005s
I20240503 08:12:52.186865 17746 raft_consensus.cc:504] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.187224 17718 raft_consensus.cc:348] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.187317 17722 raft_consensus.cc:348] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.187486 17718 raft_consensus.cc:374] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.187536 17722 raft_consensus.cc:374] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.187592 17718 raft_consensus.cc:729] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.187644 17722 raft_consensus.cc:729] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.187819 17718 consensus_queue.cc:260] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.187891 17722 consensus_queue.cc:260] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.188383 17718 ts_tablet_manager.cc:1398] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:52.188696 17718 tablet_bootstrap.cc:492] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
W20240503 08:12:52.189560 17644 leader_election.cc:341] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.190171 17746 leader_election.cc:288] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.191133 17719 tablet_bootstrap.cc:492] T a2f9b49da78f44acb5a4f554eef1ead7 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.191313 17719 ts_tablet_manager.cc:1367] T a2f9b49da78f44acb5a4f554eef1ead7 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.108s user 0.015s sys 0.020s
I20240503 08:12:52.191562 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f9b49da78f44acb5a4f554eef1ead7" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.191669 17722 ts_tablet_manager.cc:1398] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240503 08:12:52.191923 17722 tablet_bootstrap.cc:492] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.192021 17719 raft_consensus.cc:348] T a2f9b49da78f44acb5a4f554eef1ead7 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
W20240503 08:12:52.192152 17644 leader_election.cc:341] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.192250 17719 raft_consensus.cc:374] T a2f9b49da78f44acb5a4f554eef1ead7 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.192333 17719 raft_consensus.cc:729] T a2f9b49da78f44acb5a4f554eef1ead7 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.192590 17719 consensus_queue.cc:260] T a2f9b49da78f44acb5a4f554eef1ead7 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.193189 17719 ts_tablet_manager.cc:1398] T a2f9b49da78f44acb5a4f554eef1ead7 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:52.193497 17722 tablet_bootstrap.cc:654] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.193557 17719 tablet_bootstrap.cc:492] T 930776b028d34183b0aee54f1cc5d98d P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.194964 17719 tablet_bootstrap.cc:654] T 930776b028d34183b0aee54f1cc5d98d P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.190251 17718 tablet_bootstrap.cc:654] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.190953 17793 consensus_queue.cc:1035] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.197693 17602 raft_consensus.cc:2454] T c48f27bec58e44308b20007f7ae59c82 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.197834 17793 consensus_queue.cc:1035] T 14598a4f2af1413b835d50517b27f305 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.198539 17601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f9b49da78f44acb5a4f554eef1ead7" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.198743 17601 raft_consensus.cc:2454] T a2f9b49da78f44acb5a4f554eef1ead7 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.201385 17782 raft_consensus.cc:504] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.202073 17782 leader_election.cc:288] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.202469 17495 leader_election.cc:302] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.202980 17601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c48f27bec58e44308b20007f7ae59c82" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.203119 17722 tablet_bootstrap.cc:492] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.203171 17601 raft_consensus.cc:3037] T c48f27bec58e44308b20007f7ae59c82 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.203301 17722 ts_tablet_manager.cc:1367] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.005s
I20240503 08:12:52.204052 17722 raft_consensus.cc:348] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.204272 17722 raft_consensus.cc:374] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.204365 17722 raft_consensus.cc:729] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.204627 17722 consensus_queue.cc:260] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.204968 17724 raft_consensus.cc:2781] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.205072 17724 raft_consensus.cc:482] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.205204 17724 raft_consensus.cc:3037] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.205246 17722 ts_tablet_manager.cc:1398] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:52.205214 17897 consensus_queue.cc:1035] T 14377788ca9f4bb4af727da959857d9c P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20240503 08:12:52.205556 17722 tablet_bootstrap.cc:492] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.206192 17601 raft_consensus.cc:2454] T c48f27bec58e44308b20007f7ae59c82 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
W20240503 08:12:52.206801 17493 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.10.67:45843, user_credentials={real_user=slave}} blocked reactor thread for 70658.1us
I20240503 08:12:52.207166 17495 leader_election.cc:302] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.207468 17790 raft_consensus.cc:2781] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.207643 17790 raft_consensus.cc:686] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:52.207758 17724 raft_consensus.cc:504] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.207926 17722 tablet_bootstrap.cc:654] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.207927 17790 consensus_queue.cc:237] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.205708 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f9b49da78f44acb5a4f554eef1ead7" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:52.208673 17528 raft_consensus.cc:2379] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d15e9450254455f8e3a1d2b194661a2 in current term 1: Already voted for candidate 06335016e7f84df18efcdfacbab289b2 in this term.
I20240503 08:12:52.208639 17601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f9b49da78f44acb5a4f554eef1ead7" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.208850 17601 raft_consensus.cc:3037] T a2f9b49da78f44acb5a4f554eef1ead7 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.209290 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f9b49da78f44acb5a4f554eef1ead7" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.209579 17678 raft_consensus.cc:2379] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06335016e7f84df18efcdfacbab289b2 in current term 1: Already voted for candidate 0d15e9450254455f8e3a1d2b194661a2 in this term.
I20240503 08:12:52.210181 17641 leader_election.cc:302] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2; no voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.210582 17746 raft_consensus.cc:2726] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.211082 17604 raft_consensus.cc:3037] T 4afbd55d9ebb4908adb04063270ddcba P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.212415 17601 raft_consensus.cc:2454] T a2f9b49da78f44acb5a4f554eef1ead7 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.212823 17495 leader_election.cc:302] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.213092 17897 raft_consensus.cc:2781] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.213330 17897 raft_consensus.cc:686] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:52.214193 17897 consensus_queue.cc:237] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.214500 17746 consensus_queue.cc:1035] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.216244 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c48f27bec58e44308b20007f7ae59c82" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.216442 17678 raft_consensus.cc:3037] T c48f27bec58e44308b20007f7ae59c82 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.218544 17601 raft_consensus.cc:3037] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.221418 17746 raft_consensus.cc:482] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.221573 17746 raft_consensus.cc:504] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.221956 17893 consensus_queue.cc:1035] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.222218 17746 leader_election.cc:288] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.222954 17678 raft_consensus.cc:2454] T c48f27bec58e44308b20007f7ae59c82 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.223021 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70e5b64ee81948b0a2ed2bbb648730bf" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
W20240503 08:12:52.223596 17641 leader_election.cc:341] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.228508 17601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70e5b64ee81948b0a2ed2bbb648730bf" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:52.229120 17644 leader_election.cc:341] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.229203 17718 tablet_bootstrap.cc:492] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.229262 17644 leader_election.cc:302] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2; no voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.229394 17718 ts_tablet_manager.cc:1367] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.001s
I20240503 08:12:52.229655 17746 raft_consensus.cc:2726] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.230834 17718 raft_consensus.cc:348] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.231053 17718 raft_consensus.cc:374] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.231137 17718 raft_consensus.cc:729] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.231395 17718 consensus_queue.cc:260] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.233091 17718 ts_tablet_manager.cc:1398] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:12:52.233439 17718 tablet_bootstrap.cc:492] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.234925 17718 tablet_bootstrap.cc:654] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.236496 17719 tablet_bootstrap.cc:492] T 930776b028d34183b0aee54f1cc5d98d P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.236653 17719 ts_tablet_manager.cc:1367] T 930776b028d34183b0aee54f1cc5d98d P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.007s
I20240503 08:12:52.237484 17724 leader_election.cc:288] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.238482 17719 raft_consensus.cc:348] T 930776b028d34183b0aee54f1cc5d98d P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.238696 17719 raft_consensus.cc:374] T 930776b028d34183b0aee54f1cc5d98d P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.238785 17719 raft_consensus.cc:729] T 930776b028d34183b0aee54f1cc5d98d P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.239035 17719 consensus_queue.cc:260] T 930776b028d34183b0aee54f1cc5d98d P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.238026 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2f9b49da78f44acb5a4f554eef1ead7" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.239181 17832 consensus_queue.cc:1035] T 4afbd55d9ebb4908adb04063270ddcba P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.239604 17719 ts_tablet_manager.cc:1398] T 930776b028d34183b0aee54f1cc5d98d P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:12:52.239799 17675 raft_consensus.cc:2379] T a2f9b49da78f44acb5a4f554eef1ead7 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 06335016e7f84df18efcdfacbab289b2 in current term 1: Already voted for candidate 0d15e9450254455f8e3a1d2b194661a2 in this term.
I20240503 08:12:52.239904 17719 tablet_bootstrap.cc:492] T abd9d58bdf05436195bd0afcca4c00d3 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.241410 17744 consensus_queue.cc:1035] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240503 08:12:52.247009 17719 tablet_bootstrap.cc:654] T abd9d58bdf05436195bd0afcca4c00d3 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.249550 17718 tablet_bootstrap.cc:492] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.249728 17718 ts_tablet_manager.cc:1367] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.000s
I20240503 08:12:52.250500 17718 raft_consensus.cc:348] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.250694 17722 tablet_bootstrap.cc:492] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.250730 17718 raft_consensus.cc:374] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.250820 17718 raft_consensus.cc:729] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.250844 17722 ts_tablet_manager.cc:1367] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.045s user 0.008s sys 0.000s
I20240503 08:12:52.251077 17718 consensus_queue.cc:260] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.251824 17718 ts_tablet_manager.cc:1398] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240503 08:12:52.253789 17722 raft_consensus.cc:348] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.254005 17722 raft_consensus.cc:374] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.254096 17722 raft_consensus.cc:729] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.255321 17722 consensus_queue.cc:260] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.256521 17722 ts_tablet_manager.cc:1398] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240503 08:12:52.256834 17722 tablet_bootstrap.cc:492] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.258468 17722 tablet_bootstrap.cc:654] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.259979 17718 tablet_bootstrap.cc:492] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.261490 17718 tablet_bootstrap.cc:654] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.264665 17722 tablet_bootstrap.cc:492] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.264843 17722 ts_tablet_manager.cc:1367] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20240503 08:12:52.265581 17722 raft_consensus.cc:348] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.265813 17722 raft_consensus.cc:374] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.265894 17722 raft_consensus.cc:729] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.268358 17719 tablet_bootstrap.cc:492] T abd9d58bdf05436195bd0afcca4c00d3 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.268429 17722 consensus_queue.cc:260] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.268580 17719 ts_tablet_manager.cc:1367] T abd9d58bdf05436195bd0afcca4c00d3 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.029s user 0.013s sys 0.010s
I20240503 08:12:52.268688 17856 raft_consensus.cc:482] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.268719 17718 tablet_bootstrap.cc:492] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.269677 17718 ts_tablet_manager.cc:1367] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20240503 08:12:52.270303 17718 raft_consensus.cc:348] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.270490 17718 raft_consensus.cc:374] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.270550 17718 raft_consensus.cc:729] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.270717 17718 consensus_queue.cc:260] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.270820 17427 catalog_manager.cc:5484] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.271155 17718 ts_tablet_manager.cc:1398] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:52.271466 17718 tablet_bootstrap.cc:492] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.271302 17427 catalog_manager.cc:5484] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.272931 17718 tablet_bootstrap.cc:654] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.273309 17832 consensus_queue.cc:1035] T dc6b261ca02d4cfe89b131c0ad46c8d2 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.274652 17786 consensus_queue.cc:1035] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.268813 17856 raft_consensus.cc:504] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.275614 17856 leader_election.cc:288] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.276409 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d620ba8c8c684a73af18b9fb62ea6113" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.276638 17602 raft_consensus.cc:2454] T d620ba8c8c684a73af18b9fb62ea6113 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:52.276777 17786 consensus_queue.cc:1035] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.277070 17644 leader_election.cc:302] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.277240 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d620ba8c8c684a73af18b9fb62ea6113" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.277325 17856 raft_consensus.cc:2781] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.277431 17527 raft_consensus.cc:2454] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:52.279008 17786 consensus_queue.cc:1035] T cf0faa2ea34146b48c0842a7878e20f3 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.282119 17893 consensus_queue.cc:1035] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.277434 17856 raft_consensus.cc:482] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.282404 17856 raft_consensus.cc:3037] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.269071 17722 ts_tablet_manager.cc:1398] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:12:52.284216 17722 tablet_bootstrap.cc:492] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.285462 17856 raft_consensus.cc:504] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.288093 17722 tablet_bootstrap.cc:654] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.291842 17856 leader_election.cc:288] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.269253 17719 raft_consensus.cc:348] T abd9d58bdf05436195bd0afcca4c00d3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.293103 17719 raft_consensus.cc:374] T abd9d58bdf05436195bd0afcca4c00d3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.293198 17719 raft_consensus.cc:729] T abd9d58bdf05436195bd0afcca4c00d3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.293454 17719 consensus_queue.cc:260] T abd9d58bdf05436195bd0afcca4c00d3 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.294061 17719 ts_tablet_manager.cc:1398] T abd9d58bdf05436195bd0afcca4c00d3 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.025s user 0.000s sys 0.000s
I20240503 08:12:52.294420 17719 tablet_bootstrap.cc:492] T d7bdb7ab18e84803ae008edf16ca9d4f P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.295642 17899 consensus_queue.cc:1035] T 979822ec7a3842248c37ee6ec6bf618c P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.296145 17719 tablet_bootstrap.cc:654] T d7bdb7ab18e84803ae008edf16ca9d4f P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.296368 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d620ba8c8c684a73af18b9fb62ea6113" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.296377 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d620ba8c8c684a73af18b9fb62ea6113" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
W20240503 08:12:52.297755 17475 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240503 08:12:52.299160 17603 raft_consensus.cc:3037] T d620ba8c8c684a73af18b9fb62ea6113 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.300794 17527 raft_consensus.cc:3037] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.303324 17723 consensus_queue.cc:1035] T 01c1231eca744af282822464f9af362e P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20240503 08:12:52.304205 17718 tablet_bootstrap.cc:492] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.304422 17718 ts_tablet_manager.cc:1367] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.009s
I20240503 08:12:52.305172 17718 raft_consensus.cc:348] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.305459 17718 raft_consensus.cc:374] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.305610 17718 raft_consensus.cc:729] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.305902 17718 consensus_queue.cc:260] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.306581 17718 ts_tablet_manager.cc:1398] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:12:52.306870 17718 tablet_bootstrap.cc:492] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.308368 17718 tablet_bootstrap.cc:654] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.316239 17899 raft_consensus.cc:482] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.316392 17899 raft_consensus.cc:504] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.318048 17527 raft_consensus.cc:2454] T d620ba8c8c684a73af18b9fb62ea6113 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:52.318492 17899 leader_election.cc:288] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.320336 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c8a838b19a469ea44e7050f78bf375" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.320662 17641 leader_election.cc:302] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
W20240503 08:12:52.320889 17495 leader_election.cc:341] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.321107 17856 raft_consensus.cc:2781] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.321213 17856 raft_consensus.cc:686] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:52.321470 17856 consensus_queue.cc:237] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.322083 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c8a838b19a469ea44e7050f78bf375" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.320900 17603 raft_consensus.cc:2454] T d620ba8c8c684a73af18b9fb62ea6113 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
W20240503 08:12:52.339648 17493 leader_election.cc:341] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.339843 17493 leader_election.cc:302] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.340430 17899 raft_consensus.cc:2726] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.350901 17427 catalog_manager.cc:5484] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:52.352007 17719 tablet_bootstrap.cc:492] T d7bdb7ab18e84803ae008edf16ca9d4f P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.352141 17719 ts_tablet_manager.cc:1367] T d7bdb7ab18e84803ae008edf16ca9d4f P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.058s user 0.015s sys 0.019s
I20240503 08:12:52.352591 17718 tablet_bootstrap.cc:492] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.352711 17718 ts_tablet_manager.cc:1367] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.046s user 0.018s sys 0.007s
I20240503 08:12:52.352788 17719 raft_consensus.cc:348] T d7bdb7ab18e84803ae008edf16ca9d4f P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.352948 17719 raft_consensus.cc:374] T d7bdb7ab18e84803ae008edf16ca9d4f P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.352995 17719 raft_consensus.cc:729] T d7bdb7ab18e84803ae008edf16ca9d4f P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.353161 17719 consensus_queue.cc:260] T d7bdb7ab18e84803ae008edf16ca9d4f P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.353261 17718 raft_consensus.cc:348] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.353433 17718 raft_consensus.cc:374] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.353477 17718 raft_consensus.cc:729] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.353667 17719 ts_tablet_manager.cc:1398] T d7bdb7ab18e84803ae008edf16ca9d4f P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:52.353673 17718 consensus_queue.cc:260] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.354321 17722 tablet_bootstrap.cc:492] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.354333 17718 ts_tablet_manager.cc:1398] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:52.354452 17722 ts_tablet_manager.cc:1367] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.070s user 0.019s sys 0.019s
I20240503 08:12:52.354673 17718 tablet_bootstrap.cc:492] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.355072 17722 raft_consensus.cc:348] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.355262 17722 raft_consensus.cc:374] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.355319 17722 raft_consensus.cc:729] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.355569 17722 consensus_queue.cc:260] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.356141 17722 ts_tablet_manager.cc:1398] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:52.356410 17722 tablet_bootstrap.cc:492] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.357563 17718 tablet_bootstrap.cc:654] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.358109 17719 tablet_bootstrap.cc:492] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.360186 17722 tablet_bootstrap.cc:654] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.359380 17719 tablet_bootstrap.cc:654] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.363138 17899 raft_consensus.cc:482] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.363269 17899 raft_consensus.cc:504] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.363916 17899 leader_election.cc:288] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.364256 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56d3f2aacab848e2a887d16316b77932" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.364378 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56d3f2aacab848e2a887d16316b77932" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.364506 17676 raft_consensus.cc:2454] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.364858 17493 leader_election.cc:302] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.365089 17899 raft_consensus.cc:2781] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.365155 17899 raft_consensus.cc:482] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.365213 17899 raft_consensus.cc:3037] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
W20240503 08:12:52.365370 17495 leader_election.cc:341] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.367659 17899 raft_consensus.cc:504] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.368583 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56d3f2aacab848e2a887d16316b77932" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
W20240503 08:12:52.369104 17495 leader_election.cc:341] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.369511 17899 leader_election.cc:288] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.369741 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56d3f2aacab848e2a887d16316b77932" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.369839 17722 tablet_bootstrap.cc:492] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.369891 17676 raft_consensus.cc:3037] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.369997 17722 ts_tablet_manager.cc:1367] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.008s
I20240503 08:12:52.370604 17719 tablet_bootstrap.cc:492] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.370749 17718 tablet_bootstrap.cc:492] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.370708 17722 raft_consensus.cc:348] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.370755 17719 ts_tablet_manager.cc:1367] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.003s
I20240503 08:12:52.370908 17722 raft_consensus.cc:374] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.370954 17718 ts_tablet_manager.cc:1367] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.004s
I20240503 08:12:52.370968 17722 raft_consensus.cc:729] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.371258 17722 consensus_queue.cc:260] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.371726 17718 raft_consensus.cc:348] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.371922 17718 raft_consensus.cc:374] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.371810 17719 raft_consensus.cc:348] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.372007 17718 raft_consensus.cc:729] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.372071 17719 raft_consensus.cc:374] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.372160 17719 raft_consensus.cc:729] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.372288 17718 consensus_queue.cc:260] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.372468 17676 raft_consensus.cc:2454] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.372400 17719 consensus_queue.cc:260] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.372895 17718 ts_tablet_manager.cc:1398] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:52.372843 17493 leader_election.cc:302] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.373215 17718 tablet_bootstrap.cc:492] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.373385 17724 raft_consensus.cc:2781] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.373504 17724 raft_consensus.cc:686] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:52.373718 17724 consensus_queue.cc:237] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.374574 17722 ts_tablet_manager.cc:1398] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240503 08:12:52.375054 17718 tablet_bootstrap.cc:654] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.376899 17856 raft_consensus.cc:482] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.377014 17856 raft_consensus.cc:504] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.377589 17856 leader_election.cc:288] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.378089 17719 ts_tablet_manager.cc:1398] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20240503 08:12:52.378235 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa285ca958654cc28c88c4844a78418e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.378509 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa285ca958654cc28c88c4844a78418e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.378671 17523 raft_consensus.cc:2454] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
W20240503 08:12:52.378751 17644 leader_election.cc:341] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.378994 17641 leader_election.cc:302] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.379349 17856 raft_consensus.cc:2781] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.379460 17856 raft_consensus.cc:482] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.379534 17856 raft_consensus.cc:3037] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.380803 17719 tablet_bootstrap.cc:492] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.382174 17719 tablet_bootstrap.cc:654] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.382076 17856 raft_consensus.cc:504] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.382686 17856 leader_election.cc:288] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.382918 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa285ca958654cc28c88c4844a78418e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:52.383097 17523 raft_consensus.cc:3037] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.383064 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa285ca958654cc28c88c4844a78418e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
W20240503 08:12:52.383534 17644 leader_election.cc:341] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.386035 17523 raft_consensus.cc:2454] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:52.386364 17722 tablet_bootstrap.cc:492] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.386442 17641 leader_election.cc:302] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.386843 17856 raft_consensus.cc:2781] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.386958 17856 raft_consensus.cc:686] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:52.387208 17856 consensus_queue.cc:237] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.388094 17722 tablet_bootstrap.cc:654] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.390522 17425 catalog_manager.cc:5484] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:52.391302 17719 tablet_bootstrap.cc:492] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.391463 17719 ts_tablet_manager.cc:1367] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.006s
I20240503 08:12:52.392164 17424 catalog_manager.cc:5484] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.392115 17719 raft_consensus.cc:348] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.393416 17719 raft_consensus.cc:374] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.393488 17719 raft_consensus.cc:729] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.393702 17719 consensus_queue.cc:260] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.395735 17719 ts_tablet_manager.cc:1398] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240503 08:12:52.395994 17719 tablet_bootstrap.cc:492] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.397759 17718 tablet_bootstrap.cc:492] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.397894 17718 ts_tablet_manager.cc:1367] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.025s user 0.016s sys 0.006s
I20240503 08:12:52.397989 17786 consensus_queue.cc:1035] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.398701 17719 tablet_bootstrap.cc:654] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.398662 17718 raft_consensus.cc:348] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.398830 17718 raft_consensus.cc:374] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.398887 17718 raft_consensus.cc:729] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.399145 17718 consensus_queue.cc:260] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.399833 17718 ts_tablet_manager.cc:1398] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:12:52.400097 17718 tablet_bootstrap.cc:492] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.401063 17856 raft_consensus.cc:482] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.401182 17856 raft_consensus.cc:504] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.401631 17718 tablet_bootstrap.cc:654] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.401764 17856 leader_election.cc:288] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.402535 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cb36da26ec14e20bb9bb27ba7054e1e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.402726 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cb36da26ec14e20bb9bb27ba7054e1e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.402897 17528 raft_consensus.cc:2454] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:52.403223 17641 leader_election.cc:302] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
W20240503 08:12:52.403782 17644 leader_election.cc:341] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.403887 17856 raft_consensus.cc:2781] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.403961 17856 raft_consensus.cc:482] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.404017 17856 raft_consensus.cc:3037] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.406726 17856 raft_consensus.cc:504] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.408381 17786 consensus_queue.cc:1035] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.408907 17724 raft_consensus.cc:482] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.409035 17724 raft_consensus.cc:504] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.409642 17724 leader_election.cc:288] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.410048 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2afd3767b7ef41368dfd9f684ad4ce46" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.410063 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2afd3767b7ef41368dfd9f684ad4ce46" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:52.410866 17493 leader_election.cc:341] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
W20240503 08:12:52.411186 17495 leader_election.cc:341] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.411303 17495 leader_election.cc:302] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.411823 17724 raft_consensus.cc:2726] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.412776 17719 tablet_bootstrap.cc:492] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.412910 17719 ts_tablet_manager.cc:1367] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.000s
I20240503 08:12:52.413462 17785 consensus_queue.cc:1035] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.413657 17719 raft_consensus.cc:348] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.413820 17719 raft_consensus.cc:374] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.413884 17719 raft_consensus.cc:729] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.414054 17719 consensus_queue.cc:260] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.414640 17719 ts_tablet_manager.cc:1398] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:52.414883 17719 tablet_bootstrap.cc:492] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.415571 17785 raft_consensus.cc:482] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.415691 17785 raft_consensus.cc:504] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.416226 17785 leader_election.cc:288] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.416687 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70e5b64ee81948b0a2ed2bbb648730bf" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.416857 17678 raft_consensus.cc:2454] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:52.417199 17568 leader_election.cc:302] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.417716 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70e5b64ee81948b0a2ed2bbb648730bf" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
W20240503 08:12:52.418170 17567 leader_election.cc:341] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.419677 17785 raft_consensus.cc:2781] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.419761 17785 raft_consensus.cc:482] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.419835 17785 raft_consensus.cc:3037] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.422528 17785 raft_consensus.cc:504] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.423460 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70e5b64ee81948b0a2ed2bbb648730bf" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:52.423592 17856 leader_election.cc:288] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.423501 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cb36da26ec14e20bb9bb27ba7054e1e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.423784 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cb36da26ec14e20bb9bb27ba7054e1e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:52.423925 17523 raft_consensus.cc:3037] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
W20240503 08:12:52.424073 17644 leader_election.cc:341] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
W20240503 08:12:52.424264 17567 leader_election.cc:341] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.424784 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70e5b64ee81948b0a2ed2bbb648730bf" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.424927 17678 raft_consensus.cc:3037] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.426528 17523 raft_consensus.cc:2454] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:52.426831 17641 leader_election.cc:302] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.427261 17678 raft_consensus.cc:2454] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:52.427525 17785 leader_election.cc:288] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.427711 17568 leader_election.cc:302] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2
I20240503 08:12:52.428138 17785 raft_consensus.cc:2781] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.428350 17785 raft_consensus.cc:686] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:52.428596 17785 consensus_queue.cc:237] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.429172 17856 raft_consensus.cc:2781] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.429291 17856 raft_consensus.cc:686] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:52.429549 17719 tablet_bootstrap.cc:654] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.429498 17856 consensus_queue.cc:237] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.432317 17718 tablet_bootstrap.cc:492] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.432439 17718 ts_tablet_manager.cc:1367] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.032s user 0.020s sys 0.001s
I20240503 08:12:52.433110 17718 raft_consensus.cc:348] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.433297 17718 raft_consensus.cc:374] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.433439 17718 raft_consensus.cc:729] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.433610 17718 consensus_queue.cc:260] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.434203 17718 ts_tablet_manager.cc:1398] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:52.434463 17718 tablet_bootstrap.cc:492] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.437798 17427 catalog_manager.cc:5484] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:52.444828 17718 tablet_bootstrap.cc:654] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.448446 17785 consensus_queue.cc:1035] T f131aca1d2274b0ba4df3499cd835616 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.449884 17425 catalog_manager.cc:5484] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.462030 17719 tablet_bootstrap.cc:492] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.462030 17722 tablet_bootstrap.cc:492] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.462321 17722 ts_tablet_manager.cc:1367] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.076s user 0.034s sys 0.028s
I20240503 08:12:52.463042 17718 tablet_bootstrap.cc:492] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.462203 17719 ts_tablet_manager.cc:1367] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.009s
I20240503 08:12:52.463184 17718 ts_tablet_manager.cc:1367] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.009s
I20240503 08:12:52.462977 17722 raft_consensus.cc:348] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.463536 17722 raft_consensus.cc:374] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.463631 17722 raft_consensus.cc:729] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.463665 17719 raft_consensus.cc:348] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.464006 17719 raft_consensus.cc:374] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.463876 17722 consensus_queue.cc:260] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.464078 17719 raft_consensus.cc:729] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.464278 17719 consensus_queue.cc:260] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.464419 17722 ts_tablet_manager.cc:1398] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:52.464414 17718 raft_consensus.cc:348] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.464581 17718 raft_consensus.cc:374] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.464637 17718 raft_consensus.cc:729] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.464726 17719 ts_tablet_manager.cc:1398] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:52.464758 17722 tablet_bootstrap.cc:492] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.464809 17718 consensus_queue.cc:260] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.465291 17718 ts_tablet_manager.cc:1398] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240503 08:12:52.465538 17718 tablet_bootstrap.cc:492] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.466358 17722 tablet_bootstrap.cc:654] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.466933 17718 tablet_bootstrap.cc:654] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.467732 17856 consensus_queue.cc:1035] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.468961 17719 tablet_bootstrap.cc:492] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.470746 17719 tablet_bootstrap.cc:654] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.475081 17603 raft_consensus.cc:3037] T 930776b028d34183b0aee54f1cc5d98d P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.476871 17719 tablet_bootstrap.cc:492] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.476989 17719 ts_tablet_manager.cc:1367] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.002s
I20240503 08:12:52.477699 17719 raft_consensus.cc:348] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.477864 17719 raft_consensus.cc:374] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.477912 17719 raft_consensus.cc:729] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.478091 17719 consensus_queue.cc:260] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.478365 17746 consensus_queue.cc:1035] T 930776b028d34183b0aee54f1cc5d98d P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240503 08:12:52.480118 17724 raft_consensus.cc:482] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.480238 17724 raft_consensus.cc:504] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.480851 17724 leader_election.cc:288] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.482491 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e346620585b34fafac5e29522169927a" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.482661 17604 raft_consensus.cc:2454] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.483573 17495 leader_election.cc:302] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.483927 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e346620585b34fafac5e29522169927a" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.484119 17676 raft_consensus.cc:2454] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.484512 17719 ts_tablet_manager.cc:1398] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20240503 08:12:52.484723 17724 raft_consensus.cc:2781] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.484771 17719 tablet_bootstrap.cc:492] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.484794 17724 raft_consensus.cc:482] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.484850 17724 raft_consensus.cc:3037] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.486515 17719 tablet_bootstrap.cc:654] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.488974 17746 consensus_queue.cc:1035] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.490190 17786 raft_consensus.cc:482] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.490315 17786 raft_consensus.cc:504] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.490983 17786 leader_election.cc:288] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.492199 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cb36da26ec14e20bb9bb27ba7054e1e" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.493548 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0cb36da26ec14e20bb9bb27ba7054e1e" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.493795 17523 raft_consensus.cc:2379] T 0cb36da26ec14e20bb9bb27ba7054e1e P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69ebcf1734b949a19671e604e9a54cec in current term 1: Already voted for candidate 0d15e9450254455f8e3a1d2b194661a2 in this term.
I20240503 08:12:52.494256 17567 leader_election.cc:302] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2
I20240503 08:12:52.494777 17786 raft_consensus.cc:3037] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.496179 17899 consensus_queue.cc:1035] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.505811 17899 consensus_queue.cc:1035] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.507279 17724 raft_consensus.cc:504] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.511627 17724 leader_election.cc:288] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.512192 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e346620585b34fafac5e29522169927a" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.512504 17604 raft_consensus.cc:3037] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.513235 17722 tablet_bootstrap.cc:492] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.513235 17718 tablet_bootstrap.cc:492] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.513247 17746 consensus_queue.cc:1035] T 8d90423110fd4c65af6911bc983a9d57 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.513478 17722 ts_tablet_manager.cc:1367] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.049s user 0.016s sys 0.032s
I20240503 08:12:52.513478 17718 ts_tablet_manager.cc:1367] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.048s user 0.019s sys 0.025s
I20240503 08:12:52.514276 17722 raft_consensus.cc:348] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.514312 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e346620585b34fafac5e29522169927a" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.514451 17722 raft_consensus.cc:374] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.514531 17722 raft_consensus.cc:729] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.514557 17678 raft_consensus.cc:3037] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.514756 17722 consensus_queue.cc:260] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.515305 17722 ts_tablet_manager.cc:1398] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:52.515599 17722 tablet_bootstrap.cc:492] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.517343 17722 tablet_bootstrap.cc:654] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.517519 17678 raft_consensus.cc:2454] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.517601 17718 raft_consensus.cc:348] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.517760 17718 raft_consensus.cc:374] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.517827 17718 raft_consensus.cc:729] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.518435 17744 raft_consensus.cc:482] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.518554 17744 raft_consensus.cc:504] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.519201 17744 leader_election.cc:288] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.519255 17718 consensus_queue.cc:260] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.519927 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba8912ee43645eda5d975fe5d584d91" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.520112 17523 raft_consensus.cc:2454] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:52.520488 17641 leader_election.cc:302] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.520778 17718 ts_tablet_manager.cc:1398] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240503 08:12:52.521095 17744 raft_consensus.cc:2781] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.521189 17744 raft_consensus.cc:482] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.521246 17744 raft_consensus.cc:3037] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.522187 17724 raft_consensus.cc:482] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.522300 17724 raft_consensus.cc:504] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.522876 17724 leader_election.cc:288] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.523293 17718 tablet_bootstrap.cc:492] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.523878 17600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abd9d58bdf05436195bd0afcca4c00d3" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.524142 17600 raft_consensus.cc:2454] T abd9d58bdf05436195bd0afcca4c00d3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.524596 17495 leader_election.cc:302] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.524863 17724 raft_consensus.cc:2781] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.524936 17724 raft_consensus.cc:482] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.524993 17724 raft_consensus.cc:3037] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.525099 17718 tablet_bootstrap.cc:654] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.528059 17600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba8912ee43645eda5d975fe5d584d91" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:52.528708 17644 leader_election.cc:341] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.529397 17493 leader_election.cc:302] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.529671 17899 raft_consensus.cc:2781] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.529780 17899 raft_consensus.cc:686] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:52.530014 17899 consensus_queue.cc:237] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.531476 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abd9d58bdf05436195bd0afcca4c00d3" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.531643 17678 raft_consensus.cc:2454] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.532940 17724 raft_consensus.cc:504] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.533778 17600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abd9d58bdf05436195bd0afcca4c00d3" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.533936 17600 raft_consensus.cc:3037] T abd9d58bdf05436195bd0afcca4c00d3 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.533910 17724 leader_election.cc:288] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.534978 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abd9d58bdf05436195bd0afcca4c00d3" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.535158 17677 raft_consensus.cc:3037] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.538767 17677 raft_consensus.cc:2454] T abd9d58bdf05436195bd0afcca4c00d3 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.539636 17493 leader_election.cc:302] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.539940 17893 consensus_queue.cc:1035] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.540385 17893 raft_consensus.cc:2781] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.540541 17893 raft_consensus.cc:686] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:52.540817 17893 consensus_queue.cc:237] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.541810 17744 raft_consensus.cc:504] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.542888 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba8912ee43645eda5d975fe5d584d91" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:52.543052 17523 raft_consensus.cc:3037] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.540377 17718 tablet_bootstrap.cc:492] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.545135 17718 ts_tablet_manager.cc:1367] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.002s
I20240503 08:12:52.545926 17718 raft_consensus.cc:348] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.545907 17523 raft_consensus.cc:2454] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:52.546521 17641 leader_election.cc:302] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.546792 17746 raft_consensus.cc:2781] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.546900 17746 raft_consensus.cc:686] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:52.547102 17746 consensus_queue.cc:237] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.548314 17744 leader_election.cc:288] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.548520 17785 raft_consensus.cc:482] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.548625 17785 raft_consensus.cc:504] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.548764 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba8912ee43645eda5d975fe5d584d91" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.549443 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69e170a0107040ce87405dd80cfce759" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
W20240503 08:12:52.549904 17567 leader_election.cc:341] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.550422 17719 tablet_bootstrap.cc:492] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.550534 17719 ts_tablet_manager.cc:1367] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.002s
I20240503 08:12:52.551079 17604 raft_consensus.cc:2454] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.551148 17785 leader_election.cc:288] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.551311 17786 raft_consensus.cc:2726] T 0cb36da26ec14e20bb9bb27ba7054e1e P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.551759 17600 raft_consensus.cc:2454] T abd9d58bdf05436195bd0afcca4c00d3 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.551730 17719 raft_consensus.cc:348] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.551908 17719 raft_consensus.cc:374] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.551966 17719 raft_consensus.cc:729] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.552165 17719 consensus_queue.cc:260] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
W20240503 08:12:52.552604 17644 leader_election.cc:341] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.552695 17719 ts_tablet_manager.cc:1398] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:52.552975 17719 tablet_bootstrap.cc:492] T b54091717ba2493b813cc7dcc1ba1e7b P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.553901 17722 tablet_bootstrap.cc:492] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.554047 17722 ts_tablet_manager.cc:1367] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.039s user 0.012s sys 0.017s
I20240503 08:12:52.554527 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69e170a0107040ce87405dd80cfce759" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
W20240503 08:12:52.554986 17568 leader_election.cc:341] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.555088 17568 leader_election.cc:302] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2
I20240503 08:12:52.555295 17786 raft_consensus.cc:2726] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.554656 17719 tablet_bootstrap.cc:654] T b54091717ba2493b813cc7dcc1ba1e7b P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.555604 17722 raft_consensus.cc:348] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.555774 17722 raft_consensus.cc:374] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.555830 17722 raft_consensus.cc:729] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.556034 17722 consensus_queue.cc:260] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.557650 17722 ts_tablet_manager.cc:1398] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:12:52.557919 17722 tablet_bootstrap.cc:492] T b54091717ba2493b813cc7dcc1ba1e7b P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.563489 17722 tablet_bootstrap.cc:654] T b54091717ba2493b813cc7dcc1ba1e7b P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.546123 17718 raft_consensus.cc:374] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.563867 17718 raft_consensus.cc:729] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.564138 17718 consensus_queue.cc:260] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.566751 17718 ts_tablet_manager.cc:1398] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20240503 08:12:52.566973 17719 tablet_bootstrap.cc:492] T b54091717ba2493b813cc7dcc1ba1e7b P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.567466 17719 ts_tablet_manager.cc:1367] T b54091717ba2493b813cc7dcc1ba1e7b P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.004s
I20240503 08:12:52.567639 17718 tablet_bootstrap.cc:492] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.568163 17719 raft_consensus.cc:348] T b54091717ba2493b813cc7dcc1ba1e7b P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.568374 17719 raft_consensus.cc:374] T b54091717ba2493b813cc7dcc1ba1e7b P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.568426 17719 raft_consensus.cc:729] T b54091717ba2493b813cc7dcc1ba1e7b P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.568639 17719 consensus_queue.cc:260] T b54091717ba2493b813cc7dcc1ba1e7b P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.569164 17719 ts_tablet_manager.cc:1398] T b54091717ba2493b813cc7dcc1ba1e7b P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:52.569420 17719 tablet_bootstrap.cc:492] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.569700 17718 tablet_bootstrap.cc:654] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.570916 17719 tablet_bootstrap.cc:654] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.567243 17722 tablet_bootstrap.cc:492] T b54091717ba2493b813cc7dcc1ba1e7b P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.573112 17722 ts_tablet_manager.cc:1367] T b54091717ba2493b813cc7dcc1ba1e7b P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.003s
I20240503 08:12:52.573863 17722 raft_consensus.cc:348] T b54091717ba2493b813cc7dcc1ba1e7b P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.574085 17722 raft_consensus.cc:374] T b54091717ba2493b813cc7dcc1ba1e7b P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.574138 17722 raft_consensus.cc:729] T b54091717ba2493b813cc7dcc1ba1e7b P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.575635 17722 consensus_queue.cc:260] T b54091717ba2493b813cc7dcc1ba1e7b P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.576812 17722 ts_tablet_manager.cc:1398] T b54091717ba2493b813cc7dcc1ba1e7b P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:12:52.577123 17722 tablet_bootstrap.cc:492] T 69e170a0107040ce87405dd80cfce759 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.578915 17722 tablet_bootstrap.cc:654] T 69e170a0107040ce87405dd80cfce759 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.584355 17893 raft_consensus.cc:482] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.584503 17893 raft_consensus.cc:504] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.585222 17893 leader_election.cc:288] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.586015 17600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecc9aa5d797f429d835a9c5e8372fd4e" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:52.586527 17495 leader_election.cc:341] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.586736 17425 catalog_manager.cc:5484] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:52.591837 17786 raft_consensus.cc:482] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.592065 17786 raft_consensus.cc:504] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.593158 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5167aa62b10d4ad0a97d5388247ee1be" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.593354 17523 raft_consensus.cc:2454] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:52.593755 17567 leader_election.cc:302] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.594007 17785 raft_consensus.cc:2781] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.594074 17785 raft_consensus.cc:482] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.594141 17785 raft_consensus.cc:3037] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.594676 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5167aa62b10d4ad0a97d5388247ee1be" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.594846 17678 raft_consensus.cc:2454] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:52.595317 17786 leader_election.cc:288] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.595517 17893 raft_consensus.cc:482] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.595626 17893 raft_consensus.cc:504] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.595738 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecc9aa5d797f429d835a9c5e8372fd4e" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.596223 17893 leader_election.cc:288] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.596519 17600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70e5b64ee81948b0a2ed2bbb648730bf" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.597859 17785 raft_consensus.cc:504] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.598848 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5167aa62b10d4ad0a97d5388247ee1be" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:52.599002 17523 raft_consensus.cc:3037] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.601753 17523 raft_consensus.cc:2454] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:52.602233 17567 leader_election.cc:302] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
W20240503 08:12:52.602648 17493 leader_election.cc:341] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.602789 17493 leader_election.cc:302] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.602990 17893 raft_consensus.cc:2726] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.603937 17793 raft_consensus.cc:2781] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.604046 17793 raft_consensus.cc:686] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:52.604363 17785 leader_election.cc:288] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.604279 17793 consensus_queue.cc:237] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.605909 17790 consensus_queue.cc:1035] T 4d14d9f86bea4e43a160d30bed9a6a30 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.611764 17893 consensus_queue.cc:1035] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.613832 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70e5b64ee81948b0a2ed2bbb648730bf" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.614332 17677 raft_consensus.cc:2379] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06335016e7f84df18efcdfacbab289b2 in current term 1: Already voted for candidate 69ebcf1734b949a19671e604e9a54cec in this term.
I20240503 08:12:52.614970 17493 leader_election.cc:302] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.615525 17724 raft_consensus.cc:3037] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.619553 17893 consensus_queue.cc:1035] T c48f27bec58e44308b20007f7ae59c82 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.621575 17893 raft_consensus.cc:482] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.621737 17893 raft_consensus.cc:504] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.622371 17893 leader_election.cc:288] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.623072 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7102ed1b82548e1a30be22c6a9f28af" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:52.623603 17495 leader_election.cc:341] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.625883 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7102ed1b82548e1a30be22c6a9f28af" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
W20240503 08:12:52.626665 17493 leader_election.cc:341] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.626842 17493 leader_election.cc:302] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.627357 17893 raft_consensus.cc:2726] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.631170 17724 raft_consensus.cc:2726] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.631520 17786 raft_consensus.cc:482] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.634214 17786 raft_consensus.cc:504] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.635325 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56d3f2aacab848e2a887d16316b77932" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.636426 17786 leader_election.cc:288] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.636730 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56d3f2aacab848e2a887d16316b77932" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.637037 17677 raft_consensus.cc:2379] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69ebcf1734b949a19671e604e9a54cec in current term 1: Already voted for candidate 06335016e7f84df18efcdfacbab289b2 in this term.
I20240503 08:12:52.637549 17568 leader_election.cc:302] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2
I20240503 08:12:52.638139 17786 raft_consensus.cc:3037] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.641669 17786 raft_consensus.cc:2726] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.645144 17723 consensus_queue.cc:1035] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.653944 17723 consensus_queue.cc:1035] T 948437c8a338413c9b744147f6a8a5bd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.659161 17729 raft_consensus.cc:482] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.659384 17729 raft_consensus.cc:504] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.660106 17729 leader_election.cc:288] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.660713 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7bdb7ab18e84803ae008edf16ca9d4f" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.660900 17527 raft_consensus.cc:2454] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:52.661244 17641 leader_election.cc:302] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.661593 17729 raft_consensus.cc:2781] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.661695 17729 raft_consensus.cc:482] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.661799 17729 raft_consensus.cc:3037] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.664609 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7bdb7ab18e84803ae008edf16ca9d4f" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.665397 17602 raft_consensus.cc:2454] T d7bdb7ab18e84803ae008edf16ca9d4f P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:52.665369 17729 raft_consensus.cc:504] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.665599 17724 raft_consensus.cc:482] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.665922 17724 raft_consensus.cc:504] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.666483 17729 leader_election.cc:288] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.666910 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7bdb7ab18e84803ae008edf16ca9d4f" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:52.667095 17527 raft_consensus.cc:3037] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.670037 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5167aa62b10d4ad0a97d5388247ee1be" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.670217 17527 raft_consensus.cc:2454] T d7bdb7ab18e84803ae008edf16ca9d4f P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:52.671057 17600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7bdb7ab18e84803ae008edf16ca9d4f" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.671293 17600 raft_consensus.cc:3037] T d7bdb7ab18e84803ae008edf16ca9d4f P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.674080 17600 raft_consensus.cc:2454] T d7bdb7ab18e84803ae008edf16ca9d4f P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:52.674438 17644 leader_election.cc:302] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.675269 17729 raft_consensus.cc:2781] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.675587 17729 raft_consensus.cc:686] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:52.675395 17425 catalog_manager.cc:5484] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.675910 17729 consensus_queue.cc:237] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.676587 17724 leader_election.cc:288] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.676820 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b54091717ba2493b813cc7dcc1ba1e7b" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.677067 17677 raft_consensus.cc:2454] T b54091717ba2493b813cc7dcc1ba1e7b P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.677443 17493 leader_election.cc:302] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.677806 17724 raft_consensus.cc:2781] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.677953 17724 raft_consensus.cc:482] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.678093 17724 raft_consensus.cc:3037] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.680820 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b54091717ba2493b813cc7dcc1ba1e7b" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.681457 17897 raft_consensus.cc:482] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.681686 17602 raft_consensus.cc:2454] T b54091717ba2493b813cc7dcc1ba1e7b P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.681646 17897 raft_consensus.cc:504] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.682569 17897 leader_election.cc:288] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.682950 17600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4e39d8646445ac80703d1a84bd1824" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:52.683501 17495 leader_election.cc:341] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.683796 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4e39d8646445ac80703d1a84bd1824" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
W20240503 08:12:52.684262 17493 leader_election.cc:341] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.684379 17493 leader_election.cc:302] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.670212 17676 raft_consensus.cc:3037] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.684738 17897 raft_consensus.cc:2726] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.687623 17676 raft_consensus.cc:2454] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:52.702682 17722 tablet_bootstrap.cc:492] T 69e170a0107040ce87405dd80cfce759 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.703626 17724 raft_consensus.cc:504] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.705101 17722 ts_tablet_manager.cc:1367] T 69e170a0107040ce87405dd80cfce759 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.126s user 0.026s sys 0.035s
I20240503 08:12:52.707703 17718 tablet_bootstrap.cc:492] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.708104 17719 tablet_bootstrap.cc:492] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.708252 17719 ts_tablet_manager.cc:1367] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.139s user 0.026s sys 0.041s
I20240503 08:12:52.709264 17724 leader_election.cc:288] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.709380 17718 ts_tablet_manager.cc:1367] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.140s user 0.068s sys 0.063s
I20240503 08:12:52.709767 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b54091717ba2493b813cc7dcc1ba1e7b" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.709959 17677 raft_consensus.cc:3037] T b54091717ba2493b813cc7dcc1ba1e7b P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.710924 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b54091717ba2493b813cc7dcc1ba1e7b" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.711123 17602 raft_consensus.cc:3037] T b54091717ba2493b813cc7dcc1ba1e7b P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.712754 17718 raft_consensus.cc:348] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.713070 17718 raft_consensus.cc:374] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.710745 17722 raft_consensus.cc:348] T 69e170a0107040ce87405dd80cfce759 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.713624 17718 raft_consensus.cc:729] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.713797 17722 raft_consensus.cc:374] T 69e170a0107040ce87405dd80cfce759 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.714033 17722 raft_consensus.cc:729] T 69e170a0107040ce87405dd80cfce759 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.714570 17427 catalog_manager.cc:5484] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:52.715170 17718 consensus_queue.cc:260] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.715384 17719 raft_consensus.cc:348] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.715605 17719 raft_consensus.cc:374] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.715693 17722 consensus_queue.cc:260] T 69e170a0107040ce87405dd80cfce759 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.715811 17719 raft_consensus.cc:729] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.716843 17677 raft_consensus.cc:2454] T b54091717ba2493b813cc7dcc1ba1e7b P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.718744 17719 consensus_queue.cc:260] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.718955 17722 ts_tablet_manager.cc:1398] T 69e170a0107040ce87405dd80cfce759 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20240503 08:12:52.719877 17719 ts_tablet_manager.cc:1398] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20240503 08:12:52.719962 17722 tablet_bootstrap.cc:492] T a7102ed1b82548e1a30be22c6a9f28af P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.719082 17718 ts_tablet_manager.cc:1398] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240503 08:12:52.720175 17719 tablet_bootstrap.cc:492] T 8d8c3f774ca34e288cfa916b288ec116 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.720396 17718 tablet_bootstrap.cc:492] T bde42387397a459b9231991cc3f6b149 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.720474 17493 leader_election.cc:302] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.720759 17724 raft_consensus.cc:2781] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.720985 17724 raft_consensus.cc:686] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:52.721362 17724 consensus_queue.cc:237] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.719166 17602 raft_consensus.cc:2454] T b54091717ba2493b813cc7dcc1ba1e7b P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.719007 17424 catalog_manager.cc:5484] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.722376 17424 catalog_manager.cc:5484] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.723981 17719 tablet_bootstrap.cc:654] T 8d8c3f774ca34e288cfa916b288ec116 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.724004 17722 tablet_bootstrap.cc:654] T a7102ed1b82548e1a30be22c6a9f28af P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.725096 17718 tablet_bootstrap.cc:654] T bde42387397a459b9231991cc3f6b149 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.728010 17719 tablet_bootstrap.cc:492] T 8d8c3f774ca34e288cfa916b288ec116 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.731305 17719 ts_tablet_manager.cc:1367] T 8d8c3f774ca34e288cfa916b288ec116 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20240503 08:12:52.731465 17722 tablet_bootstrap.cc:492] T a7102ed1b82548e1a30be22c6a9f28af P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.732724 17722 ts_tablet_manager.cc:1367] T a7102ed1b82548e1a30be22c6a9f28af P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.001s
I20240503 08:12:52.733158 17719 raft_consensus.cc:348] T 8d8c3f774ca34e288cfa916b288ec116 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.733580 17719 raft_consensus.cc:374] T 8d8c3f774ca34e288cfa916b288ec116 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.733702 17719 raft_consensus.cc:729] T 8d8c3f774ca34e288cfa916b288ec116 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.734120 17718 tablet_bootstrap.cc:492] T bde42387397a459b9231991cc3f6b149 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.734113 17719 consensus_queue.cc:260] T 8d8c3f774ca34e288cfa916b288ec116 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.734611 17718 ts_tablet_manager.cc:1367] T bde42387397a459b9231991cc3f6b149 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.006s
I20240503 08:12:52.735054 17719 ts_tablet_manager.cc:1398] T 8d8c3f774ca34e288cfa916b288ec116 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:12:52.735579 17719 tablet_bootstrap.cc:492] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.735808 17718 raft_consensus.cc:348] T bde42387397a459b9231991cc3f6b149 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.736181 17718 raft_consensus.cc:374] T bde42387397a459b9231991cc3f6b149 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.736321 17718 raft_consensus.cc:729] T bde42387397a459b9231991cc3f6b149 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.736603 17718 consensus_queue.cc:260] T bde42387397a459b9231991cc3f6b149 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.736485 17427 catalog_manager.cc:5484] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:52.737318 17719 tablet_bootstrap.cc:654] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.737257 17718 ts_tablet_manager.cc:1398] T bde42387397a459b9231991cc3f6b149 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:12:52.737793 17722 raft_consensus.cc:348] T a7102ed1b82548e1a30be22c6a9f28af P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.737996 17718 tablet_bootstrap.cc:492] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.739742 17718 tablet_bootstrap.cc:654] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.740906 17897 consensus_queue.cc:1035] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.741708 17719 tablet_bootstrap.cc:492] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.741827 17719 ts_tablet_manager.cc:1367] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20240503 08:12:52.742467 17719 raft_consensus.cc:348] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.742632 17719 raft_consensus.cc:374] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.742679 17719 raft_consensus.cc:729] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.742887 17719 consensus_queue.cc:260] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.743337 17719 ts_tablet_manager.cc:1398] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240503 08:12:52.743597 17719 tablet_bootstrap.cc:492] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.745472 17719 tablet_bootstrap.cc:654] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.745536 17718 tablet_bootstrap.cc:492] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.745636 17718 ts_tablet_manager.cc:1367] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20240503 08:12:52.746037 17975 raft_consensus.cc:482] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.746152 17975 raft_consensus.cc:504] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.746685 17975 leader_election.cc:288] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.747176 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa285ca958654cc28c88c4844a78418e" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.747975 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa285ca958654cc28c88c4844a78418e" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.748173 17528 raft_consensus.cc:2379] T aa285ca958654cc28c88c4844a78418e P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69ebcf1734b949a19671e604e9a54cec in current term 1: Already voted for candidate 0d15e9450254455f8e3a1d2b194661a2 in this term.
I20240503 08:12:52.748492 17567 leader_election.cc:302] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2
I20240503 08:12:52.748816 17975 raft_consensus.cc:3037] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.748864 17722 raft_consensus.cc:374] T a7102ed1b82548e1a30be22c6a9f28af P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.749135 17722 raft_consensus.cc:729] T a7102ed1b82548e1a30be22c6a9f28af P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.749366 17722 consensus_queue.cc:260] T a7102ed1b82548e1a30be22c6a9f28af P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.751288 17975 raft_consensus.cc:2726] T aa285ca958654cc28c88c4844a78418e P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.751876 17718 raft_consensus.cc:348] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.752066 17718 raft_consensus.cc:374] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.752137 17718 raft_consensus.cc:729] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.752327 17718 consensus_queue.cc:260] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.752486 17722 ts_tablet_manager.cc:1398] T a7102ed1b82548e1a30be22c6a9f28af P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.020s user 0.012s sys 0.000s
I20240503 08:12:52.754843 17718 ts_tablet_manager.cc:1398] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20240503 08:12:52.755096 17718 tablet_bootstrap.cc:492] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.756482 17718 tablet_bootstrap.cc:654] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.758319 17722 tablet_bootstrap.cc:492] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.759603 17722 tablet_bootstrap.cc:654] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.760607 17719 tablet_bootstrap.cc:492] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.760717 17719 ts_tablet_manager.cc:1367] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.006s
I20240503 08:12:52.761322 17719 raft_consensus.cc:348] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.762424 17782 consensus_queue.cc:1035] T a2f9b49da78f44acb5a4f554eef1ead7 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.765841 17718 tablet_bootstrap.cc:492] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.765969 17718 ts_tablet_manager.cc:1367] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20240503 08:12:52.766602 17718 raft_consensus.cc:348] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.766777 17718 raft_consensus.cc:374] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.766824 17718 raft_consensus.cc:729] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.767012 17718 consensus_queue.cc:260] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.767527 17718 ts_tablet_manager.cc:1398] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240503 08:12:52.768121 17718 tablet_bootstrap.cc:492] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.768190 17722 tablet_bootstrap.cc:492] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.768280 17722 ts_tablet_manager.cc:1367] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20240503 08:12:52.769088 17722 raft_consensus.cc:348] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.761487 17719 raft_consensus.cc:374] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.769282 17722 raft_consensus.cc:374] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.769317 17719 raft_consensus.cc:729] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.769335 17722 raft_consensus.cc:729] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.769603 17718 tablet_bootstrap.cc:654] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.769608 17722 consensus_queue.cc:260] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.769737 17719 consensus_queue.cc:260] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.770722 17719 ts_tablet_manager.cc:1398] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20240503 08:12:52.770951 17719 tablet_bootstrap.cc:492] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.773267 17719 tablet_bootstrap.cc:654] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.774978 17722 ts_tablet_manager.cc:1398] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20240503 08:12:52.775271 17722 tablet_bootstrap.cc:492] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.776319 17719 tablet_bootstrap.cc:492] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.776432 17719 ts_tablet_manager.cc:1367] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240503 08:12:52.777491 17719 raft_consensus.cc:348] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.777732 17718 tablet_bootstrap.cc:492] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.777756 17719 raft_consensus.cc:374] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.777911 17718 ts_tablet_manager.cc:1367] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20240503 08:12:52.777926 17719 raft_consensus.cc:729] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.778231 17719 consensus_queue.cc:260] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.778532 17718 raft_consensus.cc:348] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.778704 17718 raft_consensus.cc:374] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.778764 17718 raft_consensus.cc:729] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.778934 17718 consensus_queue.cc:260] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.779075 17719 ts_tablet_manager.cc:1398] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:12:52.779460 17719 tablet_bootstrap.cc:492] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.780908 17719 tablet_bootstrap.cc:654] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.781749 17718 ts_tablet_manager.cc:1398] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:12:52.782042 17718 tablet_bootstrap.cc:492] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.783586 17718 tablet_bootstrap.cc:654] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.787168 17722 tablet_bootstrap.cc:654] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.788329 17719 tablet_bootstrap.cc:492] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.788453 17719 ts_tablet_manager.cc:1367] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20240503 08:12:52.789011 17722 tablet_bootstrap.cc:492] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.788954 17719 raft_consensus.cc:348] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.789090 17719 raft_consensus.cc:374] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.789135 17722 ts_tablet_manager.cc:1367] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20240503 08:12:52.789139 17719 raft_consensus.cc:729] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.789356 17719 consensus_queue.cc:260] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.789914 17719 ts_tablet_manager.cc:1398] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240503 08:12:52.789786 17722 raft_consensus.cc:348] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.790010 17722 raft_consensus.cc:374] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.790060 17722 raft_consensus.cc:729] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.790153 17719 tablet_bootstrap.cc:492] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.790225 17722 consensus_queue.cc:260] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.791358 17718 tablet_bootstrap.cc:492] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.791543 17718 ts_tablet_manager.cc:1367] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20240503 08:12:52.791924 17719 tablet_bootstrap.cc:654] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.792127 17718 raft_consensus.cc:348] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.792326 17718 raft_consensus.cc:374] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.792368 17718 raft_consensus.cc:729] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.792537 17718 consensus_queue.cc:260] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.793025 17718 ts_tablet_manager.cc:1398] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:52.793262 17718 tablet_bootstrap.cc:492] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.794721 17718 tablet_bootstrap.cc:654] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.796432 17722 ts_tablet_manager.cc:1398] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240503 08:12:52.796690 17722 tablet_bootstrap.cc:492] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.798166 17722 tablet_bootstrap.cc:654] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.799741 17718 tablet_bootstrap.cc:492] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.799863 17718 ts_tablet_manager.cc:1367] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20240503 08:12:52.800132 17722 tablet_bootstrap.cc:492] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.800240 17722 ts_tablet_manager.cc:1367] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:12:52.800485 17718 raft_consensus.cc:348] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.800668 17718 raft_consensus.cc:374] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.800727 17718 raft_consensus.cc:729] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.800792 17722 raft_consensus.cc:348] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.800940 17722 raft_consensus.cc:374] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.800990 17722 raft_consensus.cc:729] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.800909 17718 consensus_queue.cc:260] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.801175 17722 consensus_queue.cc:260] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.801529 17718 ts_tablet_manager.cc:1398] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:52.801684 17719 tablet_bootstrap.cc:492] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.801784 17719 ts_tablet_manager.cc:1367] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20240503 08:12:52.801877 17718 tablet_bootstrap.cc:492] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.802364 17719 raft_consensus.cc:348] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.802532 17719 raft_consensus.cc:374] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.802588 17719 raft_consensus.cc:729] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.802774 17719 consensus_queue.cc:260] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.803335 17718 tablet_bootstrap.cc:654] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.804173 17719 ts_tablet_manager.cc:1398] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:52.804431 17719 tablet_bootstrap.cc:492] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.804759 17722 ts_tablet_manager.cc:1398] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 08:12:52.805531 17746 raft_consensus.cc:482] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.805653 17746 raft_consensus.cc:504] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.805879 17719 tablet_bootstrap.cc:654] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.806193 17722 tablet_bootstrap.cc:492] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.806278 17746 leader_election.cc:288] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.806831 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecc9aa5d797f429d835a9c5e8372fd4e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:52.807466 17644 leader_election.cc:341] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.807694 17722 tablet_bootstrap.cc:654] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.807965 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecc9aa5d797f429d835a9c5e8372fd4e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.808154 17528 raft_consensus.cc:2454] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:52.808529 17641 leader_election.cc:302] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.809193 17744 raft_consensus.cc:2781] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.809264 17744 raft_consensus.cc:482] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.809324 17744 raft_consensus.cc:3037] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.811460 17719 tablet_bootstrap.cc:492] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.811580 17719 ts_tablet_manager.cc:1367] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.005s
I20240503 08:12:52.812263 17719 raft_consensus.cc:348] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.812450 17719 raft_consensus.cc:374] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.812494 17719 raft_consensus.cc:729] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.812708 17719 consensus_queue.cc:260] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.813292 17719 ts_tablet_manager.cc:1398] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:52.813548 17719 tablet_bootstrap.cc:492] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.815105 17719 tablet_bootstrap.cc:654] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.816896 17729 consensus_queue.cc:1035] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.817836 17718 tablet_bootstrap.cc:492] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.817951 17718 ts_tablet_manager.cc:1367] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.004s
I20240503 08:12:52.818549 17718 raft_consensus.cc:348] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.818703 17718 raft_consensus.cc:374] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.818749 17718 raft_consensus.cc:729] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.818921 17718 consensus_queue.cc:260] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.819424 17718 ts_tablet_manager.cc:1398] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:52.819475 17719 tablet_bootstrap.cc:492] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.819600 17719 ts_tablet_manager.cc:1367] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20240503 08:12:52.819654 17718 tablet_bootstrap.cc:492] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.820284 17719 raft_consensus.cc:348] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.820468 17719 raft_consensus.cc:374] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.820518 17719 raft_consensus.cc:729] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.820729 17719 consensus_queue.cc:260] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.821027 17718 tablet_bootstrap.cc:654] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.821344 17719 ts_tablet_manager.cc:1398] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:52.821606 17719 tablet_bootstrap.cc:492] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.823277 17722 tablet_bootstrap.cc:492] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.823397 17722 ts_tablet_manager.cc:1367] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.008s
I20240503 08:12:52.824698 17722 raft_consensus.cc:348] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.824816 17722 raft_consensus.cc:374] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.824846 17722 raft_consensus.cc:729] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.824957 17722 consensus_queue.cc:260] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.825273 17722 ts_tablet_manager.cc:1398] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:52.825449 17722 tablet_bootstrap.cc:492] T bde42387397a459b9231991cc3f6b149 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.826505 17722 tablet_bootstrap.cc:654] T bde42387397a459b9231991cc3f6b149 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.823597 17719 tablet_bootstrap.cc:654] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.829972 17744 raft_consensus.cc:504] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.832304 17722 tablet_bootstrap.cc:492] T bde42387397a459b9231991cc3f6b149 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.832433 17722 ts_tablet_manager.cc:1367] T bde42387397a459b9231991cc3f6b149 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240503 08:12:52.833019 17722 raft_consensus.cc:348] T bde42387397a459b9231991cc3f6b149 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.833228 17722 raft_consensus.cc:374] T bde42387397a459b9231991cc3f6b149 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.833281 17722 raft_consensus.cc:729] T bde42387397a459b9231991cc3f6b149 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.833447 17722 consensus_queue.cc:260] T bde42387397a459b9231991cc3f6b149 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.833911 17722 ts_tablet_manager.cc:1398] T bde42387397a459b9231991cc3f6b149 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:52.833802 17600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecc9aa5d797f429d835a9c5e8372fd4e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.835565 17785 raft_consensus.cc:482] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.835683 17785 raft_consensus.cc:504] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.836201 17722 tablet_bootstrap.cc:492] T 8d8c3f774ca34e288cfa916b288ec116 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.836254 17785 leader_election.cc:288] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.836699 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe04116f0cd342ec93e07e3dedeff5f5" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.836865 17677 raft_consensus.cc:2454] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:52.837261 17568 leader_election.cc:302] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.837774 17722 tablet_bootstrap.cc:654] T 8d8c3f774ca34e288cfa916b288ec116 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
W20240503 08:12:52.837900 17644 leader_election.cc:341] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.839243 17785 raft_consensus.cc:2781] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.839308 17785 raft_consensus.cc:482] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.839365 17785 raft_consensus.cc:3037] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.839540 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe04116f0cd342ec93e07e3dedeff5f5" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.840687 17744 leader_election.cc:288] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.840957 17718 tablet_bootstrap.cc:492] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:52.841058 17718 ts_tablet_manager.cc:1367] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.012s
I20240503 08:12:52.842288 17718 raft_consensus.cc:348] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.842463 17718 raft_consensus.cc:374] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.842515 17718 raft_consensus.cc:729] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.842671 17718 consensus_queue.cc:260] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.842869 17722 tablet_bootstrap.cc:492] T 8d8c3f774ca34e288cfa916b288ec116 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:52.842984 17722 ts_tablet_manager.cc:1367] T 8d8c3f774ca34e288cfa916b288ec116 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
W20240503 08:12:52.843055 17567 leader_election.cc:341] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.843217 17718 ts_tablet_manager.cc:1398] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:52.843484 17718 tablet_bootstrap.cc:492] T 6fac613df5c94dec8836c5bb2cb59445 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:52.843609 17722 raft_consensus.cc:348] T 8d8c3f774ca34e288cfa916b288ec116 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.843775 17722 raft_consensus.cc:374] T 8d8c3f774ca34e288cfa916b288ec116 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.843820 17722 raft_consensus.cc:729] T 8d8c3f774ca34e288cfa916b288ec116 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.844017 17722 consensus_queue.cc:260] T 8d8c3f774ca34e288cfa916b288ec116 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.844310 17832 consensus_queue.cc:1035] T d620ba8c8c684a73af18b9fb62ea6113 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.844947 17718 tablet_bootstrap.cc:654] T 6fac613df5c94dec8836c5bb2cb59445 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.845392 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecc9aa5d797f429d835a9c5e8372fd4e" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:52.845582 17528 raft_consensus.cc:3037] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.845607 17899 consensus_queue.cc:1035] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.846621 17719 tablet_bootstrap.cc:492] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:52.846733 17719 ts_tablet_manager.cc:1367] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.025s user 0.016s sys 0.000s
I20240503 08:12:52.847275 17719 raft_consensus.cc:348] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.847456 17719 raft_consensus.cc:374] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:52.847508 17719 raft_consensus.cc:729] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:52.847669 17719 consensus_queue.cc:260] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.848121 17719 ts_tablet_manager.cc:1398] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:12:52.848359 17719 tablet_bootstrap.cc:492] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:52.849802 17719 tablet_bootstrap.cc:654] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.851212 17785 raft_consensus.cc:504] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.851523 17746 raft_consensus.cc:482] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.851648 17722 ts_tablet_manager.cc:1398] T 8d8c3f774ca34e288cfa916b288ec116 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20240503 08:12:52.851624 17746 raft_consensus.cc:504] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.851919 17722 tablet_bootstrap.cc:492] T 601ae23f610f4f67acbbc876319b1ce5 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:52.852207 17746 leader_election.cc:288] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.852547 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c8a838b19a469ea44e7050f78bf375" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.852731 17527 raft_consensus.cc:2454] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:52.852998 17600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c8a838b19a469ea44e7050f78bf375" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.853155 17641 leader_election.cc:302] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.853188 17600 raft_consensus.cc:2454] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:52.853366 17722 tablet_bootstrap.cc:654] T 601ae23f610f4f67acbbc876319b1ce5 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:52.853498 17856 raft_consensus.cc:2781] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.853574 17856 raft_consensus.cc:482] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.853641 17856 raft_consensus.cc:3037] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.856437 17856 raft_consensus.cc:504] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.857043 17856 leader_election.cc:288] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.859875 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c8a838b19a469ea44e7050f78bf375" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:52.860080 17525 raft_consensus.cc:3037] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.862735 17600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c8a838b19a469ea44e7050f78bf375" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.862892 17600 raft_consensus.cc:3037] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.862872 17525 raft_consensus.cc:2454] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:52.863759 17641 leader_election.cc:302] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.864167 17832 raft_consensus.cc:2781] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.864277 17832 raft_consensus.cc:686] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:52.864513 17832 consensus_queue.cc:237] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.865576 17600 raft_consensus.cc:2454] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:52.865669 17856 consensus_queue.cc:1035] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.869608 17528 raft_consensus.cc:2454] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:52.869990 17641 leader_election.cc:302] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.870434 17746 raft_consensus.cc:2781] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.870566 17746 raft_consensus.cc:686] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:52.870819 17746 consensus_queue.cc:237] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.875815 17856 consensus_queue.cc:1035] T aa285ca958654cc28c88c4844a78418e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.876554 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe04116f0cd342ec93e07e3dedeff5f5" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
W20240503 08:12:52.876997 17567 leader_election.cc:341] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.877285 17785 leader_election.cc:288] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.877743 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe04116f0cd342ec93e07e3dedeff5f5" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.877954 17677 raft_consensus.cc:3037] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.880885 17677 raft_consensus.cc:2454] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:52.881332 17568 leader_election.cc:302] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2
I20240503 08:12:52.882083 17975 raft_consensus.cc:2781] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.882228 17975 raft_consensus.cc:686] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:52.882479 17975 consensus_queue.cc:237] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.896800 17724 raft_consensus.cc:482] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.897001 17724 raft_consensus.cc:504] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.897655 17724 leader_election.cc:288] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.899889 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69e170a0107040ce87405dd80cfce759" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.900094 17604 raft_consensus.cc:2454] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.900645 17495 leader_election.cc:302] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.900911 17724 raft_consensus.cc:2781] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.900972 17724 raft_consensus.cc:482] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.901026 17724 raft_consensus.cc:3037] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.902168 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69e170a0107040ce87405dd80cfce759" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.902333 17677 raft_consensus.cc:2454] T 69e170a0107040ce87405dd80cfce759 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.904136 17724 raft_consensus.cc:504] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.904901 17724 leader_election.cc:288] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.905107 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69e170a0107040ce87405dd80cfce759" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.905268 17677 raft_consensus.cc:3037] T 69e170a0107040ce87405dd80cfce759 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.905467 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69e170a0107040ce87405dd80cfce759" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.905579 17603 raft_consensus.cc:3037] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.910140 17603 raft_consensus.cc:2454] T 69e170a0107040ce87405dd80cfce759 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.910584 17495 leader_election.cc:302] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.910960 17724 raft_consensus.cc:2781] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.911075 17724 raft_consensus.cc:686] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:52.911334 17724 consensus_queue.cc:237] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.912371 17782 raft_consensus.cc:482] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.912490 17782 raft_consensus.cc:504] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.913053 17782 leader_election.cc:288] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.914340 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f833d72baefb4603bca6c4550cc03596" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.914669 17782 consensus_queue.cc:1035] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.914752 17677 raft_consensus.cc:2454] T 69e170a0107040ce87405dd80cfce759 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
W20240503 08:12:52.915760 17493 leader_election.cc:341] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.916600 17786 raft_consensus.cc:482] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.916726 17786 raft_consensus.cc:504] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.917304 17786 leader_election.cc:288] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.918114 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f833d72baefb4603bca6c4550cc03596" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:52.918560 17495 leader_election.cc:341] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:52.918669 17495 leader_election.cc:302] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.918938 17793 raft_consensus.cc:482] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.919039 17793 raft_consensus.cc:504] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.919590 17793 leader_election.cc:288] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.919937 17782 raft_consensus.cc:2726] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.920828 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7102ed1b82548e1a30be22c6a9f28af" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.920888 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7102ed1b82548e1a30be22c6a9f28af" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.920989 17525 raft_consensus.cc:2454] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:52.921056 17678 raft_consensus.cc:2454] T a7102ed1b82548e1a30be22c6a9f28af P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:52.921567 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba8912ee43645eda5d975fe5d584d91" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.921811 17567 leader_election.cc:302] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.922058 17786 raft_consensus.cc:2781] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.922143 17786 raft_consensus.cc:482] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.922209 17786 raft_consensus.cc:3037] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.922552 17793 consensus_queue.cc:1035] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.925808 17786 raft_consensus.cc:504] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.926450 17786 leader_election.cc:288] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.927980 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7102ed1b82548e1a30be22c6a9f28af" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:52.928242 17525 raft_consensus.cc:3037] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.931612 17525 raft_consensus.cc:2454] T a7102ed1b82548e1a30be22c6a9f28af P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:52.932361 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7102ed1b82548e1a30be22c6a9f28af" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.932439 17567 leader_election.cc:302] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.932545 17675 raft_consensus.cc:3037] T a7102ed1b82548e1a30be22c6a9f28af P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.932808 17785 raft_consensus.cc:2781] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.932977 17785 raft_consensus.cc:686] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:52.933265 17785 consensus_queue.cc:237] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.934463 17528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba8912ee43645eda5d975fe5d584d91" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.934754 17528 raft_consensus.cc:2379] T 1ba8912ee43645eda5d975fe5d584d91 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69ebcf1734b949a19671e604e9a54cec in current term 1: Already voted for candidate 0d15e9450254455f8e3a1d2b194661a2 in this term.
I20240503 08:12:52.935295 17675 raft_consensus.cc:2454] T a7102ed1b82548e1a30be22c6a9f28af P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:52.935488 17567 leader_election.cc:302] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2
I20240503 08:12:52.935807 17786 raft_consensus.cc:3037] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.938441 17786 raft_consensus.cc:2726] T 1ba8912ee43645eda5d975fe5d584d91 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.940193 17899 raft_consensus.cc:482] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.945708 17899 raft_consensus.cc:504] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.946372 17899 leader_election.cc:288] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.947002 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8c3f774ca34e288cfa916b288ec116" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.947242 17675 raft_consensus.cc:2454] T 8d8c3f774ca34e288cfa916b288ec116 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.947736 17493 leader_election.cc:302] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.948071 17899 raft_consensus.cc:2781] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.948169 17899 raft_consensus.cc:482] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.948269 17899 raft_consensus.cc:3037] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.951064 17899 raft_consensus.cc:504] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.952229 17899 leader_election.cc:288] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.952737 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8c3f774ca34e288cfa916b288ec116" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:52.952977 17675 raft_consensus.cc:3037] T 8d8c3f774ca34e288cfa916b288ec116 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.940351 17856 consensus_queue.cc:1035] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.955087 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8c3f774ca34e288cfa916b288ec116" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:52.955319 17604 raft_consensus.cc:3037] T 8d8c3f774ca34e288cfa916b288ec116 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.956918 17675 raft_consensus.cc:2454] T 8d8c3f774ca34e288cfa916b288ec116 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.957418 17493 leader_election.cc:302] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:52.957932 17899 raft_consensus.cc:2781] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.958052 17604 raft_consensus.cc:2454] T 8d8c3f774ca34e288cfa916b288ec116 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:52.958232 17899 raft_consensus.cc:686] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:52.958549 17899 consensus_queue.cc:237] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.958652 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8c3f774ca34e288cfa916b288ec116" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.958837 17603 raft_consensus.cc:2362] T 8d8c3f774ca34e288cfa916b288ec116 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1. Re-sending same reply.
I20240503 08:12:52.962345 17786 raft_consensus.cc:482] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.962507 17786 raft_consensus.cc:504] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.963732 17786 leader_election.cc:288] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.963699 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bde42387397a459b9231991cc3f6b149" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.963994 17675 raft_consensus.cc:2454] T bde42387397a459b9231991cc3f6b149 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:52.964373 17568 leader_election.cc:302] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.964747 17786 raft_consensus.cc:2781] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.964903 17786 raft_consensus.cc:482] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.965040 17786 raft_consensus.cc:3037] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.966800 17793 raft_consensus.cc:482] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.966969 17793 raft_consensus.cc:504] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.967569 17793 leader_election.cc:288] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.968293 17786 raft_consensus.cc:504] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.968812 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2afd3767b7ef41368dfd9f684ad4ce46" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.969210 17525 raft_consensus.cc:2454] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:52.969355 17793 consensus_queue.cc:1035] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.969739 17567 leader_election.cc:302] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.969847 17856 raft_consensus.cc:482] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.969977 17856 raft_consensus.cc:504] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.970206 17793 raft_consensus.cc:2781] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.970327 17793 raft_consensus.cc:482] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.970409 17793 raft_consensus.cc:3037] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.970881 17856 leader_election.cc:288] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:52.971594 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2afd3767b7ef41368dfd9f684ad4ce46" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.971949 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2afd3767b7ef41368dfd9f684ad4ce46" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:52.972108 17675 raft_consensus.cc:2454] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:52.973186 17793 raft_consensus.cc:504] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.973528 17603 raft_consensus.cc:2379] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d15e9450254455f8e3a1d2b194661a2 in current term 1: Already voted for candidate 69ebcf1734b949a19671e604e9a54cec in this term.
I20240503 08:12:52.974398 17793 leader_election.cc:288] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.975869 17529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2afd3767b7ef41368dfd9f684ad4ce46" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:52.976042 17529 raft_consensus.cc:3037] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.976644 17527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bde42387397a459b9231991cc3f6b149" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.976858 17527 raft_consensus.cc:2454] T bde42387397a459b9231991cc3f6b149 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:52.978873 17529 raft_consensus.cc:2454] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:52.979524 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2afd3767b7ef41368dfd9f684ad4ce46" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:52.979810 17525 raft_consensus.cc:2379] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d15e9450254455f8e3a1d2b194661a2 in current term 1: Already voted for candidate 69ebcf1734b949a19671e604e9a54cec in this term.
I20240503 08:12:52.980257 17832 consensus_queue.cc:1035] T 0cb36da26ec14e20bb9bb27ba7054e1e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:52.980818 17567 leader_election.cc:302] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.981199 17723 raft_consensus.cc:2781] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:52.981369 17723 raft_consensus.cc:686] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:52.981649 17723 consensus_queue.cc:237] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.982693 17641 leader_election.cc:302] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2; no voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:52.987679 17856 raft_consensus.cc:3037] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:52.990487 17856 raft_consensus.cc:2726] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:52.992627 17893 raft_consensus.cc:482] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.992822 17893 raft_consensus.cc:504] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.993471 17893 leader_election.cc:288] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.996663 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b83d1e0f957d43528b01dbf1b7fa6d2c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:52.996817 17897 raft_consensus.cc:482] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:52.996884 17602 raft_consensus.cc:2454] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:52.996981 17897 raft_consensus.cc:504] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:52.997296 17495 leader_election.cc:302] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:52.997563 17893 raft_consensus.cc:2781] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:52.997592 17897 leader_election.cc:288] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:52.997653 17893 raft_consensus.cc:482] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:52.997756 17893 raft_consensus.cc:3037] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.000478 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b83d1e0f957d43528b01dbf1b7fa6d2c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:53.000982 17893 raft_consensus.cc:504] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.001088 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f38b04ed0f584c4f8246b218b3f76dfb" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
W20240503 08:12:53.001565 17493 leader_election.cc:341] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:53.001628 17893 leader_election.cc:288] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
W20240503 08:12:53.002089 17493 leader_election.cc:341] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:53.002550 17603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b83d1e0f957d43528b01dbf1b7fa6d2c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:53.002753 17603 raft_consensus.cc:3037] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.002555 17678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b83d1e0f957d43528b01dbf1b7fa6d2c" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:53.004230 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2afd3767b7ef41368dfd9f684ad4ce46" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:53.006314 17603 raft_consensus.cc:2454] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
W20240503 08:12:53.007216 17493 leader_election.cc:341] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:53.010031 17495 leader_election.cc:302] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters: 0d15e9450254455f8e3a1d2b194661a2
I20240503 08:12:53.010516 17897 raft_consensus.cc:2781] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:53.010663 17897 raft_consensus.cc:686] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:53.010936 17897 consensus_queue.cc:237] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.012136 17427 catalog_manager.cc:5484] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:53.013069 17427 catalog_manager.cc:5484] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:53.017606 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f38b04ed0f584c4f8246b218b3f76dfb" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
W20240503 08:12:53.020105 17495 leader_election.cc:341] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:53.020296 17495 leader_election.cc:302] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:53.020716 17899 raft_consensus.cc:2726] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:53.021718 17786 leader_election.cc:288] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.022305 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bde42387397a459b9231991cc3f6b149" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:53.022609 17677 raft_consensus.cc:3037] T bde42387397a459b9231991cc3f6b149 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.027256 17677 raft_consensus.cc:2454] T bde42387397a459b9231991cc3f6b149 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:53.028188 17524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bde42387397a459b9231991cc3f6b149" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:53.028399 17524 raft_consensus.cc:3037] T bde42387397a459b9231991cc3f6b149 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.028887 17568 leader_election.cc:302] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:53.029614 17723 raft_consensus.cc:2781] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:53.029758 17723 raft_consensus.cc:686] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:53.030040 17723 consensus_queue.cc:237] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.031019 17524 raft_consensus.cc:2454] T bde42387397a459b9231991cc3f6b149 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:53.032881 17719 tablet_bootstrap.cc:492] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:53.033092 17719 ts_tablet_manager.cc:1367] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.185s user 0.024s sys 0.057s
I20240503 08:12:53.033401 17675 raft_consensus.cc:2454] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:53.034871 17424 catalog_manager.cc:5484] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.038635 17722 tablet_bootstrap.cc:492] T 601ae23f610f4f67acbbc876319b1ce5 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:53.038825 17722 ts_tablet_manager.cc:1367] T 601ae23f610f4f67acbbc876319b1ce5 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.187s user 0.006s sys 0.000s
I20240503 08:12:53.042657 17425 catalog_manager.cc:5484] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.043568 17425 catalog_manager.cc:5484] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.043819 17722 raft_consensus.cc:348] T 601ae23f610f4f67acbbc876319b1ce5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.044029 17722 raft_consensus.cc:374] T 601ae23f610f4f67acbbc876319b1ce5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.044149 17722 raft_consensus.cc:729] T 601ae23f610f4f67acbbc876319b1ce5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.044427 17722 consensus_queue.cc:260] T 601ae23f610f4f67acbbc876319b1ce5 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.044145 17425 catalog_manager.cc:5484] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.046209 17785 raft_consensus.cc:482] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.049571 17719 raft_consensus.cc:348] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.050210 17722 ts_tablet_manager.cc:1398] T 601ae23f610f4f67acbbc876319b1ce5 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240503 08:12:53.052278 17719 raft_consensus.cc:374] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.053083 17899 consensus_queue.cc:1035] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240503 08:12:53.054234 17719 raft_consensus.cc:729] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.055001 17975 consensus_queue.cc:1035] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.056223 17722 tablet_bootstrap.cc:492] T 686d4823ccb6499e902d6d4bb3284b05 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:53.056537 17424 catalog_manager.cc:5484] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.057068 17424 catalog_manager.cc:5484] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.058632 17722 tablet_bootstrap.cc:654] T 686d4823ccb6499e902d6d4bb3284b05 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.059492 17719 consensus_queue.cc:260] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.051271 17785 raft_consensus.cc:504] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.060154 17719 ts_tablet_manager.cc:1398] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20240503 08:12:53.060464 17719 tablet_bootstrap.cc:492] T f38b04ed0f584c4f8246b218b3f76dfb P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:53.060992 17718 tablet_bootstrap.cc:492] T 6fac613df5c94dec8836c5bb2cb59445 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:53.060966 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcdd1b33ca34becb52d034d7b9f3dcd" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:53.061718 17718 ts_tablet_manager.cc:1367] T 6fac613df5c94dec8836c5bb2cb59445 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.218s user 0.027s sys 0.074s
I20240503 08:12:53.062103 17676 raft_consensus.cc:2454] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:53.062758 17568 leader_election.cc:302] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:53.062767 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcdd1b33ca34becb52d034d7b9f3dcd" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:53.063426 17785 leader_election.cc:288] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.064124 17718 raft_consensus.cc:348] T 6fac613df5c94dec8836c5bb2cb59445 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.065800 17899 raft_consensus.cc:482] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.066269 17899 raft_consensus.cc:504] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.066979 17523 raft_consensus.cc:2454] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:53.068392 17723 raft_consensus.cc:2781] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:53.068797 17899 leader_election.cc:288] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.068769 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcdd1b33ca34becb52d034d7b9f3dcd" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:53.068918 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcdd1b33ca34becb52d034d7b9f3dcd" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:53.069382 17676 raft_consensus.cc:2454] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:53.069850 17493 leader_election.cc:302] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:53.070176 17723 raft_consensus.cc:482] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:53.070334 17723 raft_consensus.cc:3037] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.070523 17425 catalog_manager.cc:5484] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.073558 17899 raft_consensus.cc:2781] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:53.073518 17723 raft_consensus.cc:504] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.074015 17604 raft_consensus.cc:2379] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06335016e7f84df18efcdfacbab289b2 in current term 1: Already voted for candidate 69ebcf1734b949a19671e604e9a54cec in this term.
I20240503 08:12:53.074759 17723 leader_election.cc:288] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.073695 17899 raft_consensus.cc:482] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:53.077203 17899 raft_consensus.cc:3037] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.078698 17975 consensus_queue.cc:1035] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.079296 17975 raft_consensus.cc:482] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.079473 17975 raft_consensus.cc:504] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.079823 17899 raft_consensus.cc:504] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.080068 17975 leader_election.cc:288] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.080358 17899 leader_election.cc:288] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.075129 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcdd1b33ca34becb52d034d7b9f3dcd" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:53.080590 17523 raft_consensus.cc:2379] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 69ebcf1734b949a19671e604e9a54cec in current term 1: Already voted for candidate 06335016e7f84df18efcdfacbab289b2 in this term.
I20240503 08:12:53.080713 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4e39d8646445ac80703d1a84bd1824" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:53.075340 17719 tablet_bootstrap.cc:654] T f38b04ed0f584c4f8246b218b3f76dfb P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.080895 17675 raft_consensus.cc:2454] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:53.081290 17568 leader_election.cc:302] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:53.075420 17718 raft_consensus.cc:374] T 6fac613df5c94dec8836c5bb2cb59445 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.081558 17975 raft_consensus.cc:2781] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:53.081578 17718 raft_consensus.cc:729] T 6fac613df5c94dec8836c5bb2cb59445 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.081681 17975 raft_consensus.cc:482] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:53.081765 17975 raft_consensus.cc:3037] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.075824 17676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcdd1b33ca34becb52d034d7b9f3dcd" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:53.081909 17524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4e39d8646445ac80703d1a84bd1824" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:53.082047 17676 raft_consensus.cc:3037] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.082098 17524 raft_consensus.cc:2454] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:53.082386 17718 consensus_queue.cc:260] T 6fac613df5c94dec8836c5bb2cb59445 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.083050 17718 ts_tablet_manager.cc:1398] T 6fac613df5c94dec8836c5bb2cb59445 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.021s user 0.000s sys 0.002s
I20240503 08:12:53.083348 17718 tablet_bootstrap.cc:492] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:53.083969 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcdd1b33ca34becb52d034d7b9f3dcd" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:53.084230 17602 raft_consensus.cc:2379] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 06335016e7f84df18efcdfacbab289b2 in current term 1: Already voted for candidate 69ebcf1734b949a19671e604e9a54cec in this term.
I20240503 08:12:53.084959 17676 raft_consensus.cc:2454] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:53.085039 17718 tablet_bootstrap.cc:654] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.087584 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbcdd1b33ca34becb52d034d7b9f3dcd" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:53.087870 17677 raft_consensus.cc:2379] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 06335016e7f84df18efcdfacbab289b2 in current term 1: Already voted for candidate 69ebcf1734b949a19671e604e9a54cec in this term.
I20240503 08:12:53.088613 17899 consensus_queue.cc:1035] T abd9d58bdf05436195bd0afcca4c00d3 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.088783 17790 consensus_queue.cc:1035] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.090200 17975 raft_consensus.cc:504] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.092264 17523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4e39d8646445ac80703d1a84bd1824" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:53.092471 17523 raft_consensus.cc:3037] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.092948 17493 leader_election.cc:302] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:53.093113 17568 leader_election.cc:302] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters: 06335016e7f84df18efcdfacbab289b2
I20240503 08:12:53.093365 17790 raft_consensus.cc:2726] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240503 08:12:53.095626 17723 raft_consensus.cc:2781] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:53.096354 17723 raft_consensus.cc:686] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:53.096449 17790 consensus_queue.cc:1035] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.097766 17975 leader_election.cc:288] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.097913 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa4e39d8646445ac80703d1a84bd1824" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:53.100314 17722 tablet_bootstrap.cc:492] T 686d4823ccb6499e902d6d4bb3284b05 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:53.106694 17677 raft_consensus.cc:3037] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.107537 17722 ts_tablet_manager.cc:1367] T 686d4823ccb6499e902d6d4bb3284b05 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.008s
I20240503 08:12:53.108805 17723 consensus_queue.cc:237] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.110349 17722 raft_consensus.cc:348] T 686d4823ccb6499e902d6d4bb3284b05 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.110615 17722 raft_consensus.cc:374] T 686d4823ccb6499e902d6d4bb3284b05 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.110700 17722 raft_consensus.cc:729] T 686d4823ccb6499e902d6d4bb3284b05 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.110945 17722 consensus_queue.cc:260] T 686d4823ccb6499e902d6d4bb3284b05 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.111534 17722 ts_tablet_manager.cc:1398] T 686d4823ccb6499e902d6d4bb3284b05 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 08:12:53.111879 17722 tablet_bootstrap.cc:492] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:53.113618 17746 consensus_queue.cc:1035] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.113723 17722 tablet_bootstrap.cc:654] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.118283 17523 raft_consensus.cc:2454] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:53.118660 17567 leader_election.cc:302] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:53.118934 17677 raft_consensus.cc:2454] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:53.119071 17782 raft_consensus.cc:482] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.119169 17793 raft_consensus.cc:2781] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:53.119305 17793 raft_consensus.cc:686] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:53.119267 17782 raft_consensus.cc:504] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.119585 17793 consensus_queue.cc:237] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.119925 17782 leader_election.cc:288] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.120738 17899 consensus_queue.cc:1035] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20240503 08:12:53.126186 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601ae23f610f4f67acbbc876319b1ce5" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:53.132542 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601ae23f610f4f67acbbc876319b1ce5" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
W20240503 08:12:53.132256 17495 leader_election.cc:341] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:53.133996 17718 tablet_bootstrap.cc:492] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:53.134014 17677 raft_consensus.cc:2454] T 601ae23f610f4f67acbbc876319b1ce5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:53.135308 17722 tablet_bootstrap.cc:492] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:53.134861 17899 consensus_queue.cc:1035] T b54091717ba2493b813cc7dcc1ba1e7b P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20240503 08:12:53.135535 17719 tablet_bootstrap.cc:492] T f38b04ed0f584c4f8246b218b3f76dfb P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:53.136036 17493 leader_election.cc:302] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters: 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:53.136639 17718 ts_tablet_manager.cc:1367] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.051s user 0.010s sys 0.000s
I20240503 08:12:53.136930 17899 raft_consensus.cc:2781] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:53.138464 17722 ts_tablet_manager.cc:1367] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20240503 08:12:53.144129 17899 raft_consensus.cc:482] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:53.144265 17899 raft_consensus.cc:3037] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.145565 17425 catalog_manager.cc:5484] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.149111 17832 consensus_queue.cc:1035] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20240503 08:12:53.151841 17719 ts_tablet_manager.cc:1367] T f38b04ed0f584c4f8246b218b3f76dfb P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.075s user 0.021s sys 0.025s
I20240503 08:12:53.151120 17856 consensus_queue.cc:1035] T d7bdb7ab18e84803ae008edf16ca9d4f P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20240503 08:12:53.157752 17856 consensus_queue.cc:1035] T 1ba8912ee43645eda5d975fe5d584d91 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20240503 08:12:53.151986 17718 raft_consensus.cc:348] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.155529 17722 raft_consensus.cc:348] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.163661 17722 raft_consensus.cc:374] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.163802 17722 raft_consensus.cc:729] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.164050 17722 consensus_queue.cc:260] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.164680 17722 ts_tablet_manager.cc:1398] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.026s user 0.001s sys 0.000s
I20240503 08:12:53.164999 17722 tablet_bootstrap.cc:492] T 387c7945cff64b3fa22f7a94b1b301f8 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:53.166198 17718 raft_consensus.cc:374] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.166466 17718 raft_consensus.cc:729] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.166816 17718 consensus_queue.cc:260] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.168933 17719 raft_consensus.cc:348] T f38b04ed0f584c4f8246b218b3f76dfb P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.169404 17718 ts_tablet_manager.cc:1398] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.031s user 0.001s sys 0.001s
I20240503 08:12:53.169693 17718 tablet_bootstrap.cc:492] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:53.170933 17719 raft_consensus.cc:374] T f38b04ed0f584c4f8246b218b3f76dfb P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.171044 17719 raft_consensus.cc:729] T f38b04ed0f584c4f8246b218b3f76dfb P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.171080 17899 raft_consensus.cc:504] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.172468 17899 leader_election.cc:288] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.174453 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601ae23f610f4f67acbbc876319b1ce5" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:53.174417 17719 consensus_queue.cc:260] T f38b04ed0f584c4f8246b218b3f76dfb P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.174639 17675 raft_consensus.cc:3037] T 601ae23f610f4f67acbbc876319b1ce5 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.174955 17719 ts_tablet_manager.cc:1398] T f38b04ed0f584c4f8246b218b3f76dfb P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20240503 08:12:53.175348 17719 tablet_bootstrap.cc:492] T 4639818fe3664df29f4f555689f5d05d P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:53.177206 17719 tablet_bootstrap.cc:654] T 4639818fe3664df29f4f555689f5d05d P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.176460 17427 catalog_manager.cc:5484] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.178481 17718 tablet_bootstrap.cc:654] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.178902 17675 raft_consensus.cc:2454] T 601ae23f610f4f67acbbc876319b1ce5 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:53.179255 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "601ae23f610f4f67acbbc876319b1ce5" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:53.179306 17493 leader_election.cc:302] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:53.179550 17722 tablet_bootstrap.cc:654] T 387c7945cff64b3fa22f7a94b1b301f8 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.179677 17899 raft_consensus.cc:2781] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
W20240503 08:12:53.179750 17495 leader_election.cc:341] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): Illegal state: must be running to vote when last-logged opid is not known
I20240503 08:12:53.179811 17899 raft_consensus.cc:686] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:53.180106 17899 consensus_queue.cc:237] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.189186 17718 tablet_bootstrap.cc:492] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:53.189383 17718 ts_tablet_manager.cc:1367] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.000s
I20240503 08:12:53.190044 17718 raft_consensus.cc:348] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.190302 17718 raft_consensus.cc:374] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.190387 17718 raft_consensus.cc:729] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.190618 17718 consensus_queue.cc:260] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.191138 17718 ts_tablet_manager.cc:1398] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:53.191473 17718 tablet_bootstrap.cc:492] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:53.192510 17719 tablet_bootstrap.cc:492] T 4639818fe3664df29f4f555689f5d05d P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:53.192624 17719 ts_tablet_manager.cc:1367] T 4639818fe3664df29f4f555689f5d05d P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.000s
I20240503 08:12:53.193179 17722 tablet_bootstrap.cc:492] T 387c7945cff64b3fa22f7a94b1b301f8 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:53.193173 17719 raft_consensus.cc:348] T 4639818fe3664df29f4f555689f5d05d P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.193356 17719 raft_consensus.cc:374] T 4639818fe3664df29f4f555689f5d05d P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.193362 17722 ts_tablet_manager.cc:1367] T 387c7945cff64b3fa22f7a94b1b301f8 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.003s
I20240503 08:12:53.193421 17719 raft_consensus.cc:729] T 4639818fe3664df29f4f555689f5d05d P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.193631 17719 consensus_queue.cc:260] T 4639818fe3664df29f4f555689f5d05d P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.193936 17718 tablet_bootstrap.cc:654] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.194036 17722 raft_consensus.cc:348] T 387c7945cff64b3fa22f7a94b1b301f8 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.194216 17722 raft_consensus.cc:374] T 387c7945cff64b3fa22f7a94b1b301f8 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.194276 17722 raft_consensus.cc:729] T 387c7945cff64b3fa22f7a94b1b301f8 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.194448 17722 consensus_queue.cc:260] T 387c7945cff64b3fa22f7a94b1b301f8 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.194996 17722 ts_tablet_manager.cc:1398] T 387c7945cff64b3fa22f7a94b1b301f8 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 08:12:53.195287 17722 tablet_bootstrap.cc:492] T f833d72baefb4603bca6c4550cc03596 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:53.196866 17722 tablet_bootstrap.cc:654] T f833d72baefb4603bca6c4550cc03596 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.197443 17719 ts_tablet_manager.cc:1398] T 4639818fe3664df29f4f555689f5d05d P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240503 08:12:53.199100 17719 tablet_bootstrap.cc:492] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:53.200775 17719 tablet_bootstrap.cc:654] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.210183 17719 tablet_bootstrap.cc:492] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:53.210383 17719 ts_tablet_manager.cc:1367] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20240503 08:12:53.211946 17722 tablet_bootstrap.cc:492] T f833d72baefb4603bca6c4550cc03596 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:53.212074 17722 ts_tablet_manager.cc:1367] T f833d72baefb4603bca6c4550cc03596 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.004s
I20240503 08:12:53.212247 17718 tablet_bootstrap.cc:492] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:53.212366 17718 ts_tablet_manager.cc:1367] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.006s
I20240503 08:12:53.212406 17719 raft_consensus.cc:348] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.212592 17719 raft_consensus.cc:374] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.212643 17719 raft_consensus.cc:729] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.212677 17722 raft_consensus.cc:348] T f833d72baefb4603bca6c4550cc03596 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.212807 17722 raft_consensus.cc:374] T f833d72baefb4603bca6c4550cc03596 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.212849 17722 raft_consensus.cc:729] T f833d72baefb4603bca6c4550cc03596 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.212854 17719 consensus_queue.cc:260] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.212934 17718 raft_consensus.cc:348] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.213095 17718 raft_consensus.cc:374] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.213044 17722 consensus_queue.cc:260] T f833d72baefb4603bca6c4550cc03596 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.213155 17718 raft_consensus.cc:729] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.213498 17722 ts_tablet_manager.cc:1398] T f833d72baefb4603bca6c4550cc03596 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240503 08:12:53.213801 17722 tablet_bootstrap.cc:492] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:53.213800 17427 catalog_manager.cc:5484] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.215428 17722 tablet_bootstrap.cc:654] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.216830 17718 consensus_queue.cc:260] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.217191 17722 tablet_bootstrap.cc:492] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:53.217305 17722 ts_tablet_manager.cc:1367] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240503 08:12:53.217439 17718 ts_tablet_manager.cc:1398] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240503 08:12:53.217682 17718 tablet_bootstrap.cc:492] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2: Bootstrap starting.
I20240503 08:12:53.217936 17722 raft_consensus.cc:348] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.218091 17722 raft_consensus.cc:374] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.218137 17722 raft_consensus.cc:729] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.218335 17722 consensus_queue.cc:260] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.219069 17722 ts_tablet_manager.cc:1398] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:53.219295 17718 tablet_bootstrap.cc:654] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.219302 17722 tablet_bootstrap.cc:492] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:53.220829 17722 tablet_bootstrap.cc:654] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.221637 17899 raft_consensus.cc:482] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.221745 17899 raft_consensus.cc:504] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.222330 17899 leader_election.cc:288] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.222746 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe04116f0cd342ec93e07e3dedeff5f5" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:53.222807 17719 ts_tablet_manager.cc:1398] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20240503 08:12:53.222810 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe04116f0cd342ec93e07e3dedeff5f5" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:53.222986 17675 raft_consensus.cc:2379] T fe04116f0cd342ec93e07e3dedeff5f5 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06335016e7f84df18efcdfacbab289b2 in current term 1: Already voted for candidate 69ebcf1734b949a19671e604e9a54cec in this term.
I20240503 08:12:53.223534 17495 leader_election.cc:302] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2; no voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:53.224046 17719 tablet_bootstrap.cc:492] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:53.224381 17899 raft_consensus.cc:3037] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.226966 17899 raft_consensus.cc:2726] T fe04116f0cd342ec93e07e3dedeff5f5 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:53.227034 17722 tablet_bootstrap.cc:492] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:53.226982 17719 tablet_bootstrap.cc:654] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.227205 17722 ts_tablet_manager.cc:1367] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20240503 08:12:53.228000 17722 raft_consensus.cc:348] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.228458 17722 raft_consensus.cc:374] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.228518 17722 raft_consensus.cc:729] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.228757 17722 consensus_queue.cc:260] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.229442 17899 raft_consensus.cc:482] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.229554 17899 raft_consensus.cc:504] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.230127 17899 leader_election.cc:288] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.230440 17722 ts_tablet_manager.cc:1398] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:12:53.230695 17722 tablet_bootstrap.cc:492] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:53.231015 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7232c68b68b8434ea816445c62b9dcc7" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:53.231209 17675 raft_consensus.cc:2454] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:53.232297 17722 tablet_bootstrap.cc:654] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.233485 17493 leader_election.cc:302] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:53.233739 17899 raft_consensus.cc:2781] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:53.233820 17899 raft_consensus.cc:482] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:53.233879 17899 raft_consensus.cc:3037] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.234092 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7232c68b68b8434ea816445c62b9dcc7" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:53.234293 17602 raft_consensus.cc:2454] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:53.237210 17899 raft_consensus.cc:504] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.237728 17722 tablet_bootstrap.cc:492] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:53.237843 17722 ts_tablet_manager.cc:1367] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20240503 08:12:53.238250 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7232c68b68b8434ea816445c62b9dcc7" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:53.238405 17675 raft_consensus.cc:3037] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.238917 17722 raft_consensus.cc:348] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.239069 17722 raft_consensus.cc:374] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.239110 17722 raft_consensus.cc:729] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.239305 17722 consensus_queue.cc:260] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.239928 17722 ts_tablet_manager.cc:1398] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:53.240177 17722 tablet_bootstrap.cc:492] T 4639818fe3664df29f4f555689f5d05d P 0d15e9450254455f8e3a1d2b194661a2: Bootstrap starting.
I20240503 08:12:53.240796 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7232c68b68b8434ea816445c62b9dcc7" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:53.240979 17602 raft_consensus.cc:3037] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.241043 17899 leader_election.cc:288] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.241695 17718 tablet_bootstrap.cc:492] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2: No bootstrap required, opened a new log
I20240503 08:12:53.241829 17718 ts_tablet_manager.cc:1367] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.008s
I20240503 08:12:53.241881 17722 tablet_bootstrap.cc:654] T 4639818fe3664df29f4f555689f5d05d P 0d15e9450254455f8e3a1d2b194661a2: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.242551 17718 raft_consensus.cc:348] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.242712 17718 raft_consensus.cc:374] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.242763 17718 raft_consensus.cc:729] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.242957 17718 consensus_queue.cc:260] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.241003 17675 raft_consensus.cc:2454] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:53.245887 17493 leader_election.cc:302] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:53.246223 17899 raft_consensus.cc:2781] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:53.246341 17899 raft_consensus.cc:686] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:53.246582 17899 consensus_queue.cc:237] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.246901 17718 ts_tablet_manager.cc:1398] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240503 08:12:53.249181 17602 raft_consensus.cc:2454] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:53.251914 17722 tablet_bootstrap.cc:492] T 4639818fe3664df29f4f555689f5d05d P 0d15e9450254455f8e3a1d2b194661a2: No bootstrap required, opened a new log
I20240503 08:12:53.252076 17722 ts_tablet_manager.cc:1367] T 4639818fe3664df29f4f555689f5d05d P 0d15e9450254455f8e3a1d2b194661a2: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.001s
I20240503 08:12:53.252827 17722 raft_consensus.cc:348] T 4639818fe3664df29f4f555689f5d05d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.252977 17722 raft_consensus.cc:374] T 4639818fe3664df29f4f555689f5d05d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.253022 17722 raft_consensus.cc:729] T 4639818fe3664df29f4f555689f5d05d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.253201 17722 consensus_queue.cc:260] T 4639818fe3664df29f4f555689f5d05d P 0d15e9450254455f8e3a1d2b194661a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.254490 17722 ts_tablet_manager.cc:1398] T 4639818fe3664df29f4f555689f5d05d P 0d15e9450254455f8e3a1d2b194661a2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 08:12:53.254294 17424 catalog_manager.cc:5484] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.255549 17719 tablet_bootstrap.cc:492] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:53.255710 17719 ts_tablet_manager.cc:1367] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.015s
I20240503 08:12:53.256485 17719 raft_consensus.cc:348] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.256644 17719 raft_consensus.cc:374] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.256691 17719 raft_consensus.cc:729] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.256860 17719 consensus_queue.cc:260] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.257429 17719 ts_tablet_manager.cc:1398] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 08:12:53.257779 17719 tablet_bootstrap.cc:492] T 387c7945cff64b3fa22f7a94b1b301f8 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:53.259076 17719 tablet_bootstrap.cc:654] T 387c7945cff64b3fa22f7a94b1b301f8 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.260674 17719 tablet_bootstrap.cc:492] T 387c7945cff64b3fa22f7a94b1b301f8 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:53.260790 17719 ts_tablet_manager.cc:1367] T 387c7945cff64b3fa22f7a94b1b301f8 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240503 08:12:53.261447 17719 raft_consensus.cc:348] T 387c7945cff64b3fa22f7a94b1b301f8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.261611 17719 raft_consensus.cc:374] T 387c7945cff64b3fa22f7a94b1b301f8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.261664 17719 raft_consensus.cc:729] T 387c7945cff64b3fa22f7a94b1b301f8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.261822 17719 consensus_queue.cc:260] T 387c7945cff64b3fa22f7a94b1b301f8 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.262262 17719 ts_tablet_manager.cc:1398] T 387c7945cff64b3fa22f7a94b1b301f8 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:53.262568 17719 tablet_bootstrap.cc:492] T 6fac613df5c94dec8836c5bb2cb59445 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:53.263798 17719 tablet_bootstrap.cc:654] T 6fac613df5c94dec8836c5bb2cb59445 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.265308 17719 tablet_bootstrap.cc:492] T 6fac613df5c94dec8836c5bb2cb59445 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:53.265432 17719 ts_tablet_manager.cc:1367] T 6fac613df5c94dec8836c5bb2cb59445 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:12:53.265998 17719 raft_consensus.cc:348] T 6fac613df5c94dec8836c5bb2cb59445 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.266155 17719 raft_consensus.cc:374] T 6fac613df5c94dec8836c5bb2cb59445 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.266211 17719 raft_consensus.cc:729] T 6fac613df5c94dec8836c5bb2cb59445 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.266392 17719 consensus_queue.cc:260] T 6fac613df5c94dec8836c5bb2cb59445 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.266819 17719 ts_tablet_manager.cc:1398] T 6fac613df5c94dec8836c5bb2cb59445 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:53.267081 17719 tablet_bootstrap.cc:492] T 601ae23f610f4f67acbbc876319b1ce5 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:53.268530 17719 tablet_bootstrap.cc:654] T 601ae23f610f4f67acbbc876319b1ce5 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.270221 17719 tablet_bootstrap.cc:492] T 601ae23f610f4f67acbbc876319b1ce5 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:53.270331 17719 ts_tablet_manager.cc:1367] T 601ae23f610f4f67acbbc876319b1ce5 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:12:53.270867 17719 raft_consensus.cc:348] T 601ae23f610f4f67acbbc876319b1ce5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.271005 17719 raft_consensus.cc:374] T 601ae23f610f4f67acbbc876319b1ce5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.271035 17719 raft_consensus.cc:729] T 601ae23f610f4f67acbbc876319b1ce5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.271231 17719 consensus_queue.cc:260] T 601ae23f610f4f67acbbc876319b1ce5 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.271679 17719 ts_tablet_manager.cc:1398] T 601ae23f610f4f67acbbc876319b1ce5 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240503 08:12:53.271888 17719 tablet_bootstrap.cc:492] T 686d4823ccb6499e902d6d4bb3284b05 P 69ebcf1734b949a19671e604e9a54cec: Bootstrap starting.
I20240503 08:12:53.273109 17719 tablet_bootstrap.cc:654] T 686d4823ccb6499e902d6d4bb3284b05 P 69ebcf1734b949a19671e604e9a54cec: Neither blocks nor log segments found. Creating new log.
I20240503 08:12:53.274549 17719 tablet_bootstrap.cc:492] T 686d4823ccb6499e902d6d4bb3284b05 P 69ebcf1734b949a19671e604e9a54cec: No bootstrap required, opened a new log
I20240503 08:12:53.274662 17719 ts_tablet_manager.cc:1367] T 686d4823ccb6499e902d6d4bb3284b05 P 69ebcf1734b949a19671e604e9a54cec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 08:12:53.275280 17719 raft_consensus.cc:348] T 686d4823ccb6499e902d6d4bb3284b05 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.275453 17719 raft_consensus.cc:374] T 686d4823ccb6499e902d6d4bb3284b05 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 08:12:53.275507 17719 raft_consensus.cc:729] T 686d4823ccb6499e902d6d4bb3284b05 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Initialized, Role: FOLLOWER
I20240503 08:12:53.275692 17719 consensus_queue.cc:260] T 686d4823ccb6499e902d6d4bb3284b05 P 69ebcf1734b949a19671e604e9a54cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.276106 17719 ts_tablet_manager.cc:1398] T 686d4823ccb6499e902d6d4bb3284b05 P 69ebcf1734b949a19671e604e9a54cec: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 08:12:53.276455 17832 raft_consensus.cc:482] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.276556 17832 raft_consensus.cc:504] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.277099 17832 leader_election.cc:288] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:53.277467 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f38b04ed0f584c4f8246b218b3f76dfb" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:53.277513 17524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f38b04ed0f584c4f8246b218b3f76dfb" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:53.277642 17602 raft_consensus.cc:2454] T f38b04ed0f584c4f8246b218b3f76dfb P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:53.277670 17524 raft_consensus.cc:2454] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:53.277949 17644 leader_election.cc:302] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:53.278400 17832 raft_consensus.cc:2781] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:53.278463 17832 raft_consensus.cc:482] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:53.278522 17832 raft_consensus.cc:3037] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.280242 17832 raft_consensus.cc:504] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.280699 17832 leader_election.cc:288] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:53.281049 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f38b04ed0f584c4f8246b218b3f76dfb" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:53.281049 17524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f38b04ed0f584c4f8246b218b3f76dfb" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:53.281252 17602 raft_consensus.cc:3037] T f38b04ed0f584c4f8246b218b3f76dfb P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.281252 17524 raft_consensus.cc:3037] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.283843 17524 raft_consensus.cc:2454] T f38b04ed0f584c4f8246b218b3f76dfb P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:53.283843 17602 raft_consensus.cc:2454] T f38b04ed0f584c4f8246b218b3f76dfb P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:53.284262 17641 leader_election.cc:302] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:53.284531 17832 raft_consensus.cc:2781] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:53.284653 17832 raft_consensus.cc:686] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:53.284863 17832 consensus_queue.cc:237] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.287860 17427 catalog_manager.cc:5484] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:53.297950 17899 raft_consensus.cc:482] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.298115 17899 raft_consensus.cc:504] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.298668 17899 leader_election.cc:288] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.299103 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "686d4823ccb6499e902d6d4bb3284b05" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:53.299113 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "686d4823ccb6499e902d6d4bb3284b05" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:53.299265 17602 raft_consensus.cc:2454] T 686d4823ccb6499e902d6d4bb3284b05 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:53.299350 17675 raft_consensus.cc:2454] T 686d4823ccb6499e902d6d4bb3284b05 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:53.299667 17495 leader_election.cc:302] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:53.299913 17899 raft_consensus.cc:2781] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:53.299990 17899 raft_consensus.cc:482] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:53.300061 17899 raft_consensus.cc:3037] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.302862 17899 raft_consensus.cc:504] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.303526 17899 leader_election.cc:288] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.303781 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "686d4823ccb6499e902d6d4bb3284b05" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:53.303946 17602 raft_consensus.cc:3037] T 686d4823ccb6499e902d6d4bb3284b05 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.304021 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "686d4823ccb6499e902d6d4bb3284b05" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:53.304167 17675 raft_consensus.cc:3037] T 686d4823ccb6499e902d6d4bb3284b05 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.306756 17602 raft_consensus.cc:2454] T 686d4823ccb6499e902d6d4bb3284b05 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:53.306756 17675 raft_consensus.cc:2454] T 686d4823ccb6499e902d6d4bb3284b05 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:53.307199 17495 leader_election.cc:302] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:53.307479 17899 raft_consensus.cc:2781] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
W20240503 08:12:53.307523 17475 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240503 08:12:53.307632 17899 raft_consensus.cc:686] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:53.307837 17899 consensus_queue.cc:237] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.310657 17427 catalog_manager.cc:5484] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.314254 17832 consensus_queue.cc:1035] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.318111 17602 raft_consensus.cc:3037] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.320762 17832 consensus_queue.cc:1035] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.328685 17832 raft_consensus.cc:482] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.328825 17832 raft_consensus.cc:504] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.329411 17832 leader_election.cc:288] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:53.329752 17524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fac613df5c94dec8836c5bb2cb59445" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:53.329774 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fac613df5c94dec8836c5bb2cb59445" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:53.329919 17524 raft_consensus.cc:2454] T 6fac613df5c94dec8836c5bb2cb59445 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:53.329938 17602 raft_consensus.cc:2454] T 6fac613df5c94dec8836c5bb2cb59445 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 0.
I20240503 08:12:53.330206 17641 leader_election.cc:302] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:53.330458 17832 raft_consensus.cc:2781] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:53.330566 17832 raft_consensus.cc:482] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:53.330634 17832 raft_consensus.cc:3037] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.332484 17832 raft_consensus.cc:504] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.332983 17832 leader_election.cc:288] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:53.333429 17524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fac613df5c94dec8836c5bb2cb59445" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:53.333632 17524 raft_consensus.cc:3037] T 6fac613df5c94dec8836c5bb2cb59445 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.333412 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fac613df5c94dec8836c5bb2cb59445" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:53.334118 17602 raft_consensus.cc:3037] T 6fac613df5c94dec8836c5bb2cb59445 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.334386 17782 consensus_queue.cc:1035] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.336452 17524 raft_consensus.cc:2454] T 6fac613df5c94dec8836c5bb2cb59445 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:53.336618 17602 raft_consensus.cc:2454] T 6fac613df5c94dec8836c5bb2cb59445 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d15e9450254455f8e3a1d2b194661a2 in term 1.
I20240503 08:12:53.336825 17641 leader_election.cc:302] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:53.337057 17832 raft_consensus.cc:2781] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:53.337193 17832 raft_consensus.cc:686] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d15e9450254455f8e3a1d2b194661a2, State: Running, Role: LEADER
I20240503 08:12:53.337471 17832 consensus_queue.cc:237] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.338685 17793 consensus_queue.cc:1035] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.339702 17782 consensus_queue.cc:1035] T 69e170a0107040ce87405dd80cfce759 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.343043 17723 consensus_queue.cc:1035] T a7102ed1b82548e1a30be22c6a9f28af P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.346038 17427 catalog_manager.cc:5484] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67). New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } }
I20240503 08:12:53.347182 17899 raft_consensus.cc:482] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.347994 17899 raft_consensus.cc:504] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.348531 17899 leader_election.cc:288] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.348779 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4639818fe3664df29f4f555689f5d05d" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:53.348986 17604 raft_consensus.cc:2454] T 4639818fe3664df29f4f555689f5d05d P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:53.349532 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4639818fe3664df29f4f555689f5d05d" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:53.349622 17495 leader_election.cc:302] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:53.349736 17677 raft_consensus.cc:2454] T 4639818fe3664df29f4f555689f5d05d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:53.349848 17899 raft_consensus.cc:2781] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:53.349958 17899 raft_consensus.cc:482] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:53.350030 17899 raft_consensus.cc:3037] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.352650 17899 raft_consensus.cc:504] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.353654 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4639818fe3664df29f4f555689f5d05d" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:53.353658 17899 leader_election.cc:288] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.353868 17604 raft_consensus.cc:3037] T 4639818fe3664df29f4f555689f5d05d P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.354817 17723 consensus_queue.cc:1035] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.355291 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4639818fe3664df29f4f555689f5d05d" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:53.355523 17677 raft_consensus.cc:3037] T 4639818fe3664df29f4f555689f5d05d P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.358436 17677 raft_consensus.cc:2454] T 4639818fe3664df29f4f555689f5d05d P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:53.358764 17493 leader_election.cc:302] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 0d15e9450254455f8e3a1d2b194661a2; no voters:
I20240503 08:12:53.359053 17899 raft_consensus.cc:2781] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:53.359216 17899 raft_consensus.cc:686] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:53.359548 17899 consensus_queue.cc:237] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.360391 17604 raft_consensus.cc:2454] T 4639818fe3664df29f4f555689f5d05d P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:53.364871 17723 consensus_queue.cc:1035] T fe04116f0cd342ec93e07e3dedeff5f5 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.366312 17424 catalog_manager.cc:5484] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.379945 17899 consensus_queue.cc:1035] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.384240 17899 consensus_queue.cc:1035] T 8d8c3f774ca34e288cfa916b288ec116 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.390003 17832 consensus_queue.cc:1035] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.393846 17856 consensus_queue.cc:1035] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.407760 17723 raft_consensus.cc:482] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.407928 17723 raft_consensus.cc:504] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.408591 17723 leader_election.cc:288] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.409030 17524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f833d72baefb4603bca6c4550cc03596" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:53.409139 17723 consensus_queue.cc:1035] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.409255 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f833d72baefb4603bca6c4550cc03596" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:53.409498 17675 raft_consensus.cc:2454] T f833d72baefb4603bca6c4550cc03596 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:53.409276 17524 raft_consensus.cc:2454] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 0.
I20240503 08:12:53.409922 17568 leader_election.cc:302] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:53.410326 17723 raft_consensus.cc:2781] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:53.410429 17723 raft_consensus.cc:482] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:53.410557 17723 raft_consensus.cc:3037] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.411953 17975 consensus_queue.cc:1035] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.413596 17786 consensus_queue.cc:1035] T bde42387397a459b9231991cc3f6b149 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.413733 17723 raft_consensus.cc:504] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.414285 17723 leader_election.cc:288] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Requested vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.415433 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f833d72baefb4603bca6c4550cc03596" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:53.415643 17675 raft_consensus.cc:3037] T f833d72baefb4603bca6c4550cc03596 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.417047 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f833d72baefb4603bca6c4550cc03596" candidate_uuid: "69ebcf1734b949a19671e604e9a54cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2"
I20240503 08:12:53.417227 17525 raft_consensus.cc:3037] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.418028 17675 raft_consensus.cc:2454] T f833d72baefb4603bca6c4550cc03596 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:53.419157 17525 raft_consensus.cc:2454] T f833d72baefb4603bca6c4550cc03596 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69ebcf1734b949a19671e604e9a54cec in term 1.
I20240503 08:12:53.420256 17567 leader_election.cc:302] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:53.420538 17793 consensus_queue.cc:1035] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.421043 17793 raft_consensus.cc:2781] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:53.421209 17793 raft_consensus.cc:686] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Becoming Leader. State: Replica: 69ebcf1734b949a19671e604e9a54cec, State: Running, Role: LEADER
I20240503 08:12:53.421474 17793 consensus_queue.cc:237] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.434701 17427 catalog_manager.cc:5484] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 69ebcf1734b949a19671e604e9a54cec (127.16.10.66). New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.447029 17856 raft_consensus.cc:482] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.447182 17856 raft_consensus.cc:504] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.447759 17856 leader_election.cc:288] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725), 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:53.448125 17525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b83d1e0f957d43528b01dbf1b7fa6d2c" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06335016e7f84df18efcdfacbab289b2" is_pre_election: true
I20240503 08:12:53.448204 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b83d1e0f957d43528b01dbf1b7fa6d2c" candidate_uuid: "0d15e9450254455f8e3a1d2b194661a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:53.448442 17604 raft_consensus.cc:2379] T b83d1e0f957d43528b01dbf1b7fa6d2c P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d15e9450254455f8e3a1d2b194661a2 in current term 1: Already voted for candidate 06335016e7f84df18efcdfacbab289b2 in this term.
I20240503 08:12:53.448720 17644 leader_election.cc:302] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d15e9450254455f8e3a1d2b194661a2; no voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec
I20240503 08:12:53.448930 17899 raft_consensus.cc:482] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 08:12:53.448966 17856 raft_consensus.cc:3037] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.449664 17899 raft_consensus.cc:504] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.450215 17899 leader_election.cc:288] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.450748 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "387c7945cff64b3fa22f7a94b1b301f8" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec" is_pre_election: true
I20240503 08:12:53.450816 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "387c7945cff64b3fa22f7a94b1b301f8" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2" is_pre_election: true
I20240503 08:12:53.450927 17604 raft_consensus.cc:2454] T 387c7945cff64b3fa22f7a94b1b301f8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:53.450989 17675 raft_consensus.cc:2454] T 387c7945cff64b3fa22f7a94b1b301f8 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 0.
I20240503 08:12:53.451315 17495 leader_election.cc:302] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:53.451746 17899 raft_consensus.cc:2781] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 08:12:53.451861 17899 raft_consensus.cc:482] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 08:12:53.451867 17856 raft_consensus.cc:2726] T b83d1e0f957d43528b01dbf1b7fa6d2c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 08:12:53.451983 17899 raft_consensus.cc:3037] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.453933 17899 raft_consensus.cc:504] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.454416 17899 leader_election.cc:288] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Requested vote from peers 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107), 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:53.454753 17604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "387c7945cff64b3fa22f7a94b1b301f8" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ebcf1734b949a19671e604e9a54cec"
I20240503 08:12:53.454774 17675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "387c7945cff64b3fa22f7a94b1b301f8" candidate_uuid: "06335016e7f84df18efcdfacbab289b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d15e9450254455f8e3a1d2b194661a2"
I20240503 08:12:53.454949 17675 raft_consensus.cc:3037] T 387c7945cff64b3fa22f7a94b1b301f8 P 0d15e9450254455f8e3a1d2b194661a2 [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.454952 17604 raft_consensus.cc:3037] T 387c7945cff64b3fa22f7a94b1b301f8 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.457569 17675 raft_consensus.cc:2454] T 387c7945cff64b3fa22f7a94b1b301f8 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:53.457616 17604 raft_consensus.cc:2454] T 387c7945cff64b3fa22f7a94b1b301f8 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06335016e7f84df18efcdfacbab289b2 in term 1.
I20240503 08:12:53.457964 17495 leader_election.cc:302] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06335016e7f84df18efcdfacbab289b2, 69ebcf1734b949a19671e604e9a54cec; no voters:
I20240503 08:12:53.458259 17899 raft_consensus.cc:2781] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 08:12:53.458451 17899 raft_consensus.cc:686] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Becoming Leader. State: Replica: 06335016e7f84df18efcdfacbab289b2, State: Running, Role: LEADER
I20240503 08:12:53.458709 17899 consensus_queue.cc:237] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } }
I20240503 08:12:53.461462 17424 catalog_manager.cc:5484] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06335016e7f84df18efcdfacbab289b2 (127.16.10.65). New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:53.533787 17793 consensus_queue.cc:1035] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.538064 17786 consensus_queue.cc:1035] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.544941 17899 consensus_queue.cc:1035] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.548046 17899 consensus_queue.cc:1035] T b83d1e0f957d43528b01dbf1b7fa6d2c P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.631767 17786 consensus_queue.cc:1035] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.635438 17786 consensus_queue.cc:1035] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.648451 17790 consensus_queue.cc:1035] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.651551 17604 raft_consensus.cc:3037] T 601ae23f610f4f67acbbc876319b1ce5 P 69ebcf1734b949a19671e604e9a54cec [term 0 FOLLOWER]: Advancing to term 1
I20240503 08:12:53.655474 17899 consensus_queue.cc:1035] T 601ae23f610f4f67acbbc876319b1ce5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.670748 17856 consensus_queue.cc:1035] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.674531 17746 consensus_queue.cc:1035] T f38b04ed0f584c4f8246b218b3f76dfb P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.806926 17897 consensus_queue.cc:1035] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.810505 17897 consensus_queue.cc:1035] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.816138 16425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240503 08:12:53.818316 17790 consensus_queue.cc:1035] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 08:12:53.819195 18097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:53.819694 18098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 08:12:53.821246 18100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 08:12:53.823043 16425 server_base.cc:1034] running on GCE node
I20240503 08:12:53.823359 17782 consensus_queue.cc:1035] T 4639818fe3664df29f4f555689f5d05d P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.823494 16425 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 08:12:53.823551 16425 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 08:12:53.823580 16425 hybrid_clock.cc:648] HybridClock initialized: now 1714723973823577 us; error 0 us; skew 500 ppm
I20240503 08:12:53.823725 16425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 08:12:53.825707 16425 webserver.cc:460] Webserver started at http://127.16.10.68:37507/ using document root <none> and password file <none>
I20240503 08:12:53.825958 16425 fs_manager.cc:359] Metadata directory not provided
I20240503 08:12:53.826032 16425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 08:12:53.826149 16425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 08:12:53.826890 16425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-3-root/instance:
uuid: "ce6c1f2801e84e869ab18938724e5aad"
format_stamp: "Formatted at 2024-05-03 08:12:53 on dist-test-slave-6p8x"
I20240503 08:12:53.830013 16425 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20240503 08:12:53.832067 18107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:53.832552 16425 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20240503 08:12:53.832659 16425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-3-root
uuid: "ce6c1f2801e84e869ab18938724e5aad"
format_stamp: "Formatted at 2024-05-03 08:12:53 on dist-test-slave-6p8x"
I20240503 08:12:53.832770 16425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 08:12:53.842667 17856 consensus_queue.cc:1035] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.846593 17782 consensus_queue.cc:1035] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.848169 17785 consensus_queue.cc:1035] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.850857 17785 consensus_queue.cc:1035] T f833d72baefb4603bca6c4550cc03596 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.874086 16425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 08:12:53.874650 16425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 08:12:53.875156 17744 consensus_queue.cc:1035] T 6fac613df5c94dec8836c5bb2cb59445 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.878173 17899 consensus_queue.cc:1035] T 686d4823ccb6499e902d6d4bb3284b05 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:53.887632 16425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 08:12:53.888527 16425 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 08:12:53.888584 16425 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:53.888654 16425 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 08:12:53.888686 16425 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 08:12:53.903614 16425 rpc_server.cc:307] RPC server started. Bound to: 127.16.10.68:43291
I20240503 08:12:53.903622 18175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.10.68:43291 every 8 connection(s)
I20240503 08:12:53.904596 16425 auto_leader_rebalancer-test.cc:405] add a tserver: ce6c1f2801e84e869ab18938724e5aad
I20240503 08:12:53.909461 18176 heartbeater.cc:347] Connected to a master server at 127.16.10.126:46597
I20240503 08:12:53.909560 18176 heartbeater.cc:464] Registering TS with master...
I20240503 08:12:53.909864 18176 heartbeater.cc:511] Master 127.16.10.126:46597 requested a full tablet report, sending...
I20240503 08:12:53.910540 17427 ts_manager.cc:194] Registered new tserver with Master: ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291)
I20240503 08:12:53.911196 17427 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44470
I20240503 08:12:54.041343 17782 consensus_queue.cc:1035] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:54.046054 17782 consensus_queue.cc:1035] T 387c7945cff64b3fa22f7a94b1b301f8 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 08:12:54.328696 17675 consensus_queue.cc:237] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:54.331073 17602 raft_consensus.cc:1261] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:12:54.331130 17524 raft_consensus.cc:1261] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:12:54.331673 17856 consensus_queue.cc:1035] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:54.332492 17744 consensus_queue.cc:1035] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:54.334573 17856 raft_consensus.cc:2932] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:54.335820 17524 raft_consensus.cc:2932] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
W20240503 08:12:54.340154 17644 consensus_peers.cc:485] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ecc9aa5d797f429d835a9c5e8372fd4e. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:12:54.341133 17426 catalog_manager.cc:5484] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:54.341970 17675 consensus_queue.cc:237] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:54.343883 17602 raft_consensus.cc:2932] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:54.348428 17525 raft_consensus.cc:1261] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:12:54.348910 17856 consensus_queue.cc:1035] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:54.348935 17604 raft_consensus.cc:1261] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:12:54.349680 17744 consensus_queue.cc:1035] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240503 08:12:54.349893 17644 consensus_peers.cc:485] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39f868a4bdfb403fa462b79cc5507546. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:12:54.353749 17856 raft_consensus.cc:2932] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:54.354373 17524 raft_consensus.cc:2932] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:54.355249 17602 raft_consensus.cc:2932] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:54.362702 17427 catalog_manager.cc:5484] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:54.367687 17524 consensus_queue.cc:237] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:54.370491 17602 raft_consensus.cc:1261] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:12:54.371119 17675 raft_consensus.cc:1261] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:12:54.371091 17899 consensus_queue.cc:1035] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:54.371554 17782 consensus_queue.cc:1035] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:54.373737 17899 raft_consensus.cc:2932] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:54.377488 17602 raft_consensus.cc:2932] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:54.378319 17675 raft_consensus.cc:2932] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
W20240503 08:12:54.379758 17495 consensus_peers.cc:485] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e346620585b34fafac5e29522169927a. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:12:54.379804 17424 catalog_manager.cc:5484] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:54.387836 17602 consensus_queue.cc:237] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:54.389863 17524 raft_consensus.cc:1261] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:12:54.390087 17677 raft_consensus.cc:1261] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:12:54.390327 17786 consensus_queue.cc:1035] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:54.390759 17786 consensus_queue.cc:1035] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:54.392953 17786 raft_consensus.cc:2932] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:54.394546 17524 raft_consensus.cc:2932] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:54.399646 17427 catalog_manager.cc:5484] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:54.399966 17677 raft_consensus.cc:2932] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
W20240503 08:12:54.402402 17570 consensus_peers.cc:485] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2afd3767b7ef41368dfd9f684ad4ce46. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:12:54.802999 18202 ts_tablet_manager.cc:902] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725)
I20240503 08:12:54.804682 18202 tablet_copy_client.cc:308] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Beginning tablet copy session from remote peer at address 127.16.10.65:41725
I20240503 08:12:54.810683 17539 tablet_copy_service.cc:140] P 06335016e7f84df18efcdfacbab289b2: Received BeginTabletCopySession request for tablet e346620585b34fafac5e29522169927a from peer ce6c1f2801e84e869ab18938724e5aad ({username='slave'} at 127.0.0.1:54126)
I20240503 08:12:54.810885 17539 tablet_copy_service.cc:161] P 06335016e7f84df18efcdfacbab289b2: Beginning new tablet copy session on tablet e346620585b34fafac5e29522169927a from peer ce6c1f2801e84e869ab18938724e5aad at {username='slave'} at 127.0.0.1:54126: session id = ce6c1f2801e84e869ab18938724e5aad-e346620585b34fafac5e29522169927a
I20240503 08:12:54.813895 17539 tablet_copy_source_session.cc:205] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:12:54.815719 18202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e346620585b34fafac5e29522169927a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:54.820927 18202 tablet_copy_client.cc:783] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 0 data blocks...
I20240503 08:12:54.821285 18202 tablet_copy_client.cc:647] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 1 WAL segments...
I20240503 08:12:54.823669 18202 tablet_copy_client.cc:523] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:12:54.827296 18202 tablet_bootstrap.cc:492] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad: Bootstrap starting.
I20240503 08:12:54.834116 18202 tablet_bootstrap.cc:492] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:12:54.834503 18202 tablet_bootstrap.cc:492] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad: Bootstrap complete.
I20240503 08:12:54.834738 18202 ts_tablet_manager.cc:1367] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20240503 08:12:54.835338 18202 raft_consensus.cc:348] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:54.835552 18202 raft_consensus.cc:729] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce6c1f2801e84e869ab18938724e5aad, State: Initialized, Role: LEARNER
I20240503 08:12:54.835683 18202 consensus_queue.cc:260] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:54.836266 18176 heartbeater.cc:503] Master 127.16.10.126:46597 was elected leader, sending a full tablet report...
I20240503 08:12:54.836314 18202 ts_tablet_manager.cc:1398] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240503 08:12:54.836853 17539 tablet_copy_service.cc:342] P 06335016e7f84df18efcdfacbab289b2: Request end of tablet copy session ce6c1f2801e84e869ab18938724e5aad-e346620585b34fafac5e29522169927a received from {username='slave'} at 127.0.0.1:54126
I20240503 08:12:54.836961 17539 tablet_copy_service.cc:433] P 06335016e7f84df18efcdfacbab289b2: ending tablet copy session ce6c1f2801e84e869ab18938724e5aad-e346620585b34fafac5e29522169927a on tablet e346620585b34fafac5e29522169927a with peer ce6c1f2801e84e869ab18938724e5aad
I20240503 08:12:54.852245 18202 ts_tablet_manager.cc:902] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:54.853400 18202 tablet_copy_client.cc:308] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Beginning tablet copy session from remote peer at address 127.16.10.67:45843
I20240503 08:12:54.859292 17688 tablet_copy_service.cc:140] P 0d15e9450254455f8e3a1d2b194661a2: Received BeginTabletCopySession request for tablet 39f868a4bdfb403fa462b79cc5507546 from peer ce6c1f2801e84e869ab18938724e5aad ({username='slave'} at 127.0.0.1:34862)
I20240503 08:12:54.859458 17688 tablet_copy_service.cc:161] P 0d15e9450254455f8e3a1d2b194661a2: Beginning new tablet copy session on tablet 39f868a4bdfb403fa462b79cc5507546 from peer ce6c1f2801e84e869ab18938724e5aad at {username='slave'} at 127.0.0.1:34862: session id = ce6c1f2801e84e869ab18938724e5aad-39f868a4bdfb403fa462b79cc5507546
I20240503 08:12:54.861944 17688 tablet_copy_source_session.cc:205] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:12:54.863013 18202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39f868a4bdfb403fa462b79cc5507546. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:54.867868 18202 tablet_copy_client.cc:783] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 0 data blocks...
I20240503 08:12:54.868104 18202 tablet_copy_client.cc:647] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 1 WAL segments...
I20240503 08:12:54.871066 18202 tablet_copy_client.cc:523] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:12:54.873842 18202 tablet_bootstrap.cc:492] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap starting.
I20240503 08:12:54.880206 18202 tablet_bootstrap.cc:492] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:12:54.880494 18202 tablet_bootstrap.cc:492] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap complete.
I20240503 08:12:54.880697 18202 ts_tablet_manager.cc:1367] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.000s
I20240503 08:12:54.881417 18202 raft_consensus.cc:348] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:54.881646 18202 raft_consensus.cc:729] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce6c1f2801e84e869ab18938724e5aad, State: Initialized, Role: LEARNER
I20240503 08:12:54.881848 18202 consensus_queue.cc:260] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:54.882405 18202 ts_tablet_manager.cc:1398] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 08:12:54.883435 17688 tablet_copy_service.cc:342] P 0d15e9450254455f8e3a1d2b194661a2: Request end of tablet copy session ce6c1f2801e84e869ab18938724e5aad-39f868a4bdfb403fa462b79cc5507546 received from {username='slave'} at 127.0.0.1:34862
I20240503 08:12:54.883533 17688 tablet_copy_service.cc:433] P 0d15e9450254455f8e3a1d2b194661a2: ending tablet copy session ce6c1f2801e84e869ab18938724e5aad-39f868a4bdfb403fa462b79cc5507546 on tablet 39f868a4bdfb403fa462b79cc5507546 with peer ce6c1f2801e84e869ab18938724e5aad
I20240503 08:12:54.914891 18202 ts_tablet_manager.cc:902] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:12:54.916033 18202 tablet_copy_client.cc:308] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Beginning tablet copy session from remote peer at address 127.16.10.67:45843
I20240503 08:12:54.916576 17688 tablet_copy_service.cc:140] P 0d15e9450254455f8e3a1d2b194661a2: Received BeginTabletCopySession request for tablet ecc9aa5d797f429d835a9c5e8372fd4e from peer ce6c1f2801e84e869ab18938724e5aad ({username='slave'} at 127.0.0.1:34862)
I20240503 08:12:54.916697 17688 tablet_copy_service.cc:161] P 0d15e9450254455f8e3a1d2b194661a2: Beginning new tablet copy session on tablet ecc9aa5d797f429d835a9c5e8372fd4e from peer ce6c1f2801e84e869ab18938724e5aad at {username='slave'} at 127.0.0.1:34862: session id = ce6c1f2801e84e869ab18938724e5aad-ecc9aa5d797f429d835a9c5e8372fd4e
I20240503 08:12:54.918872 17688 tablet_copy_source_session.cc:205] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:12:54.919899 18202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecc9aa5d797f429d835a9c5e8372fd4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:54.925513 18202 tablet_copy_client.cc:783] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 0 data blocks...
I20240503 08:12:54.925738 18202 tablet_copy_client.cc:647] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 1 WAL segments...
I20240503 08:12:54.927167 18202 tablet_copy_client.cc:523] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:12:54.929797 18202 tablet_bootstrap.cc:492] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad: Bootstrap starting.
I20240503 08:12:54.934954 18202 tablet_bootstrap.cc:492] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:12:54.935309 18202 tablet_bootstrap.cc:492] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad: Bootstrap complete.
I20240503 08:12:54.935539 18202 ts_tablet_manager.cc:1367] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad: Time spent bootstrapping tablet: real 0.006s user 0.007s sys 0.000s
I20240503 08:12:54.936131 18202 raft_consensus.cc:348] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:54.936358 18202 raft_consensus.cc:729] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce6c1f2801e84e869ab18938724e5aad, State: Initialized, Role: LEARNER
I20240503 08:12:54.936553 18202 consensus_queue.cc:260] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:54.937566 18202 ts_tablet_manager.cc:1398] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:54.938086 17688 tablet_copy_service.cc:342] P 0d15e9450254455f8e3a1d2b194661a2: Request end of tablet copy session ce6c1f2801e84e869ab18938724e5aad-ecc9aa5d797f429d835a9c5e8372fd4e received from {username='slave'} at 127.0.0.1:34862
I20240503 08:12:54.938155 17688 tablet_copy_service.cc:433] P 0d15e9450254455f8e3a1d2b194661a2: ending tablet copy session ce6c1f2801e84e869ab18938724e5aad-ecc9aa5d797f429d835a9c5e8372fd4e on tablet ecc9aa5d797f429d835a9c5e8372fd4e with peer ce6c1f2801e84e869ab18938724e5aad
I20240503 08:12:54.988528 18202 ts_tablet_manager.cc:902] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:54.989888 18202 tablet_copy_client.cc:308] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Beginning tablet copy session from remote peer at address 127.16.10.66:39107
I20240503 08:12:54.999143 17614 tablet_copy_service.cc:140] P 69ebcf1734b949a19671e604e9a54cec: Received BeginTabletCopySession request for tablet 2afd3767b7ef41368dfd9f684ad4ce46 from peer ce6c1f2801e84e869ab18938724e5aad ({username='slave'} at 127.0.0.1:41646)
I20240503 08:12:54.999286 17614 tablet_copy_service.cc:161] P 69ebcf1734b949a19671e604e9a54cec: Beginning new tablet copy session on tablet 2afd3767b7ef41368dfd9f684ad4ce46 from peer ce6c1f2801e84e869ab18938724e5aad at {username='slave'} at 127.0.0.1:41646: session id = ce6c1f2801e84e869ab18938724e5aad-2afd3767b7ef41368dfd9f684ad4ce46
I20240503 08:12:55.001946 17614 tablet_copy_source_session.cc:205] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:12:55.003139 18202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2afd3767b7ef41368dfd9f684ad4ce46. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:55.007668 18202 tablet_copy_client.cc:783] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 0 data blocks...
I20240503 08:12:55.007884 18202 tablet_copy_client.cc:647] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 1 WAL segments...
I20240503 08:12:55.009234 18202 tablet_copy_client.cc:523] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:12:55.011955 18202 tablet_bootstrap.cc:492] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap starting.
I20240503 08:12:55.016682 18202 tablet_bootstrap.cc:492] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:12:55.016949 18202 tablet_bootstrap.cc:492] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap complete.
I20240503 08:12:55.017161 18202 ts_tablet_manager.cc:1367] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20240503 08:12:55.017778 18202 raft_consensus.cc:348] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:55.017997 18202 raft_consensus.cc:729] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce6c1f2801e84e869ab18938724e5aad, State: Initialized, Role: LEARNER
I20240503 08:12:55.018172 18202 consensus_queue.cc:260] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:55.019094 18202 ts_tablet_manager.cc:1398] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 08:12:55.019671 17614 tablet_copy_service.cc:342] P 69ebcf1734b949a19671e604e9a54cec: Request end of tablet copy session ce6c1f2801e84e869ab18938724e5aad-2afd3767b7ef41368dfd9f684ad4ce46 received from {username='slave'} at 127.0.0.1:41646
I20240503 08:12:55.019758 17614 tablet_copy_service.cc:433] P 69ebcf1734b949a19671e604e9a54cec: ending tablet copy session ce6c1f2801e84e869ab18938724e5aad-2afd3767b7ef41368dfd9f684ad4ce46 on tablet 2afd3767b7ef41368dfd9f684ad4ce46 with peer ce6c1f2801e84e869ab18938724e5aad
I20240503 08:12:55.258988 18151 raft_consensus.cc:1203] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:12:55.312013 18151 raft_consensus.cc:1203] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:12:55.500341 18151 raft_consensus.cc:1203] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:12:55.506194 18151 raft_consensus.cc:1203] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:12:55.764734 18227 raft_consensus.cc:1050] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2: attempting to promote NON_VOTER ce6c1f2801e84e869ab18938724e5aad to VOTER
I20240503 08:12:55.765590 18227 consensus_queue.cc:237] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:55.767818 18151 raft_consensus.cc:1261] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:55.768255 17678 raft_consensus.cc:1261] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:55.768415 18227 consensus_queue.cc:1035] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:55.768605 17604 raft_consensus.cc:1261] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:55.768710 17782 consensus_queue.cc:1035] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:55.769130 17782 consensus_queue.cc:1035] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:55.771900 18227 raft_consensus.cc:2932] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.772472 17602 raft_consensus.cc:2932] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.776364 18151 raft_consensus.cc:2932] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.784060 17427 catalog_manager.cc:5484] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:12:55.790264 17677 raft_consensus.cc:2932] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.795437 17525 consensus_queue.cc:237] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:55.797200 18151 raft_consensus.cc:1261] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:55.797911 17602 raft_consensus.cc:1261] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:55.797981 17782 consensus_queue.cc:1035] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:55.798380 18235 consensus_queue.cc:1035] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:55.800412 17782 raft_consensus.cc:2932] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.801522 18151 raft_consensus.cc:2932] T e346620585b34fafac5e29522169927a P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.803236 17411 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet e346620585b34fafac5e29522169927a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:12:55.803929 17604 raft_consensus.cc:2932] T e346620585b34fafac5e29522169927a P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.807606 17427 catalog_manager.cc:5484] T e346620585b34fafac5e29522169927a P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:12:55.812821 17668 tablet_service.cc:1514] Processing DeleteTablet for tablet e346620585b34fafac5e29522169927a with delete_type TABLET_DATA_TOMBSTONED (TS 0d15e9450254455f8e3a1d2b194661a2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34844
I20240503 08:12:55.814045 18240 tablet_replica.cc:330] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2: stopping tablet replica
I20240503 08:12:55.814252 18240 raft_consensus.cc:2229] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:55.814486 18240 raft_consensus.cc:2258] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:55.816545 18240 ts_tablet_manager.cc:1875] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:12:55.821285 18240 ts_tablet_manager.cc:1888] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:12:55.821409 18240 log.cc:1196] T e346620585b34fafac5e29522169927a P 0d15e9450254455f8e3a1d2b194661a2: Deleting WAL directory at /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-2-root/wals/e346620585b34fafac5e29522169927a
I20240503 08:12:55.822178 17412 catalog_manager.cc:4830] TS 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): tablet e346620585b34fafac5e29522169927a (table test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]) successfully deleted
I20240503 08:12:55.897771 18228 raft_consensus.cc:1050] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2: attempting to promote NON_VOTER ce6c1f2801e84e869ab18938724e5aad to VOTER
I20240503 08:12:55.898564 18228 consensus_queue.cc:237] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:55.901119 18151 raft_consensus.cc:1261] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:55.901131 17602 raft_consensus.cc:1261] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:55.901554 17746 consensus_queue.cc:1035] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:55.902197 17524 raft_consensus.cc:1261] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:55.903209 18242 consensus_queue.cc:1035] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20240503 08:12:55.903551 17746 consensus_queue.cc:1035] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:55.906541 18228 raft_consensus.cc:2932] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.907330 17602 raft_consensus.cc:2932] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.907604 17524 raft_consensus.cc:2932] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.911958 18151 raft_consensus.cc:2932] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.912264 17426 catalog_manager.cc:5484] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:55.920903 17678 consensus_queue.cc:237] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:55.922529 18151 raft_consensus.cc:1261] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:55.922586 17604 raft_consensus.cc:1261] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:55.923015 18228 consensus_queue.cc:1035] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:55.923321 18242 consensus_queue.cc:1035] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:55.925367 17744 raft_consensus.cc:2932] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.925822 18151 raft_consensus.cc:2932] T 39f868a4bdfb403fa462b79cc5507546 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.926003 17604 raft_consensus.cc:2932] T 39f868a4bdfb403fa462b79cc5507546 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:55.928943 17412 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 39f868a4bdfb403fa462b79cc5507546 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:12:55.930981 17427 catalog_manager.cc:5484] T 39f868a4bdfb403fa462b79cc5507546 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:12:55.934463 17512 tablet_service.cc:1514] Processing DeleteTablet for tablet 39f868a4bdfb403fa462b79cc5507546 with delete_type TABLET_DATA_TOMBSTONED (TS 06335016e7f84df18efcdfacbab289b2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54090
I20240503 08:12:55.935276 18246 tablet_replica.cc:330] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2: stopping tablet replica
I20240503 08:12:55.935535 18246 raft_consensus.cc:2229] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:55.935896 18246 raft_consensus.cc:2258] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:55.936889 18246 ts_tablet_manager.cc:1875] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:12:55.941857 18246 ts_tablet_manager.cc:1888] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:12:55.941946 18246 log.cc:1196] T 39f868a4bdfb403fa462b79cc5507546 P 06335016e7f84df18efcdfacbab289b2: Deleting WAL directory at /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-0-root/wals/39f868a4bdfb403fa462b79cc5507546
I20240503 08:12:55.942503 17411 catalog_manager.cc:4830] TS 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): tablet 39f868a4bdfb403fa462b79cc5507546 (table test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]) successfully deleted
I20240503 08:12:56.054955 17786 raft_consensus.cc:1050] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec: attempting to promote NON_VOTER ce6c1f2801e84e869ab18938724e5aad to VOTER
I20240503 08:12:56.055689 17786 consensus_queue.cc:237] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:56.057888 18151 raft_consensus.cc:1261] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:56.057956 17678 raft_consensus.cc:1261] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:56.058396 18229 consensus_queue.cc:1035] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:56.058521 17524 raft_consensus.cc:1261] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:56.058691 18248 consensus_queue.cc:1035] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:56.058935 17786 consensus_queue.cc:1035] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:56.069243 18229 raft_consensus.cc:2932] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.070714 17678 raft_consensus.cc:2932] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.072654 17524 raft_consensus.cc:2932] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.075163 18151 raft_consensus.cc:2932] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.079376 17426 catalog_manager.cc:5484] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.084882 17602 consensus_queue.cc:237] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:56.087039 18151 raft_consensus.cc:1261] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:56.087170 17678 raft_consensus.cc:1261] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:56.087543 18229 consensus_queue.cc:1035] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:56.087864 18248 consensus_queue.cc:1035] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:56.089918 17785 raft_consensus.cc:2932] T 2afd3767b7ef41368dfd9f684ad4ce46 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.090799 17677 raft_consensus.cc:2932] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.093727 17414 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2afd3767b7ef41368dfd9f684ad4ce46 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:12:56.094524 18151 raft_consensus.cc:2932] T 2afd3767b7ef41368dfd9f684ad4ce46 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.096426 17424 catalog_manager.cc:5484] T 2afd3767b7ef41368dfd9f684ad4ce46 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.099786 17512 tablet_service.cc:1514] Processing DeleteTablet for tablet 2afd3767b7ef41368dfd9f684ad4ce46 with delete_type TABLET_DATA_TOMBSTONED (TS 06335016e7f84df18efcdfacbab289b2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54090
I20240503 08:12:56.100215 18246 tablet_replica.cc:330] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2: stopping tablet replica
I20240503 08:12:56.100535 18246 raft_consensus.cc:2229] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:56.100771 18246 raft_consensus.cc:2258] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:56.101507 18246 ts_tablet_manager.cc:1875] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:12:56.107228 18246 ts_tablet_manager.cc:1888] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:12:56.107369 18246 log.cc:1196] T 2afd3767b7ef41368dfd9f684ad4ce46 P 06335016e7f84df18efcdfacbab289b2: Deleting WAL directory at /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-0-root/wals/2afd3767b7ef41368dfd9f684ad4ce46
I20240503 08:12:56.108033 17411 catalog_manager.cc:4830] TS 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): tablet 2afd3767b7ef41368dfd9f684ad4ce46 (table test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]) successfully deleted
I20240503 08:12:56.115082 18242 raft_consensus.cc:1050] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2: attempting to promote NON_VOTER ce6c1f2801e84e869ab18938724e5aad to VOTER
I20240503 08:12:56.115985 18242 consensus_queue.cc:237] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:56.118122 18151 raft_consensus.cc:1261] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:56.118441 17604 raft_consensus.cc:1261] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:56.118490 17524 raft_consensus.cc:1261] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:56.118819 18228 consensus_queue.cc:1035] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:56.119035 17746 consensus_queue.cc:1035] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:56.119314 17744 consensus_queue.cc:1035] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:56.123167 17746 raft_consensus.cc:2932] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.123620 18151 raft_consensus.cc:2932] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.127738 17427 catalog_manager.cc:5484] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad reported cstate change: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.130856 17524 raft_consensus.cc:2932] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.131934 17604 raft_consensus.cc:2932] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.139807 17677 consensus_queue.cc:237] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:56.141690 18151 raft_consensus.cc:1261] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:56.141902 17524 raft_consensus.cc:1261] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:56.142143 17746 consensus_queue.cc:1035] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:56.142691 17746 consensus_queue.cc:1035] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:56.144325 18228 raft_consensus.cc:2932] T ecc9aa5d797f429d835a9c5e8372fd4e P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.144835 18151 raft_consensus.cc:2932] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.148258 17412 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ecc9aa5d797f429d835a9c5e8372fd4e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:12:56.148658 17427 catalog_manager.cc:5484] T ecc9aa5d797f429d835a9c5e8372fd4e P ce6c1f2801e84e869ab18938724e5aad reported cstate change: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.150514 17524 raft_consensus.cc:2932] T ecc9aa5d797f429d835a9c5e8372fd4e P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:56.151775 17586 tablet_service.cc:1514] Processing DeleteTablet for tablet ecc9aa5d797f429d835a9c5e8372fd4e with delete_type TABLET_DATA_TOMBSTONED (TS 69ebcf1734b949a19671e604e9a54cec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41608
I20240503 08:12:56.152469 18256 tablet_replica.cc:330] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec: stopping tablet replica
I20240503 08:12:56.152666 18256 raft_consensus.cc:2229] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:56.152932 18256 raft_consensus.cc:2258] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:56.153821 18256 ts_tablet_manager.cc:1875] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:12:56.159360 18256 ts_tablet_manager.cc:1888] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:12:56.159495 18256 log.cc:1196] T ecc9aa5d797f429d835a9c5e8372fd4e P 69ebcf1734b949a19671e604e9a54cec: Deleting WAL directory at /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-1-root/wals/ecc9aa5d797f429d835a9c5e8372fd4e
I20240503 08:12:56.160074 17414 catalog_manager.cc:4830] TS 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): tablet ecc9aa5d797f429d835a9c5e8372fd4e (table test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]) successfully deleted
I20240503 08:12:57.165436 17524 consensus_queue.cc:237] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:57.167546 17678 raft_consensus.cc:1261] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 08:12:57.167641 17495 consensus_peers.cc:485] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 519eb7f46c59460ba3b4a5613ff54894. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:12:57.167481 17604 raft_consensus.cc:1261] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:12:57.168164 18231 consensus_queue.cc:1035] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:57.168411 18257 consensus_queue.cc:1035] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:57.170730 18261 raft_consensus.cc:2932] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.171392 17678 raft_consensus.cc:2932] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.175282 17524 consensus_queue.cc:237] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:57.176101 17427 catalog_manager.cc:5484] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:57.175079 17604 raft_consensus.cc:2932] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.184649 17678 raft_consensus.cc:1261] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:12:57.184662 17604 raft_consensus.cc:1261] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 08:12:57.184974 17495 consensus_peers.cc:485] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f95209235434aa0aa22bb6fff89bbb5. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:12:57.185096 18231 consensus_queue.cc:1035] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:57.185384 18261 consensus_queue.cc:1035] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:57.187867 18257 raft_consensus.cc:2932] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.188962 17678 raft_consensus.cc:2932] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.191483 17604 raft_consensus.cc:2932] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.192843 17602 consensus_queue.cc:237] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:57.192886 17425 catalog_manager.cc:5484] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:57.196579 17524 raft_consensus.cc:1261] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:12:57.196657 17678 raft_consensus.cc:1261] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 08:12:57.197153 17570 consensus_peers.cc:485] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5167aa62b10d4ad0a97d5388247ee1be. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:12:57.197320 18258 consensus_queue.cc:1035] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:57.197567 18272 consensus_queue.cc:1035] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:57.199904 18258 raft_consensus.cc:2932] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.202356 17525 raft_consensus.cc:2932] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.204731 17678 raft_consensus.cc:2932] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.205365 17424 catalog_manager.cc:5484] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:57.207751 17525 consensus_queue.cc:237] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:57.211146 17675 raft_consensus.cc:1261] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 08:12:57.211828 17495 consensus_peers.cc:485] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db0fbf6819374978ab404bbfde4b9d42. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:12:57.211905 18257 consensus_queue.cc:1035] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:57.212181 17604 raft_consensus.cc:1261] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:12:57.212628 18257 consensus_queue.cc:1035] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:12:57.214526 18231 raft_consensus.cc:2932] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.215596 17678 raft_consensus.cc:2932] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.221200 17427 catalog_manager.cc:5484] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.222481 17604 raft_consensus.cc:2932] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:12:57.645272 18278 ts_tablet_manager.cc:902] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:12:57.654038 18278 tablet_copy_client.cc:308] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Beginning tablet copy session from remote peer at address 127.16.10.66:39107
I20240503 08:12:57.654686 17614 tablet_copy_service.cc:140] P 69ebcf1734b949a19671e604e9a54cec: Received BeginTabletCopySession request for tablet 5167aa62b10d4ad0a97d5388247ee1be from peer ce6c1f2801e84e869ab18938724e5aad ({username='slave'} at 127.0.0.1:41646)
I20240503 08:12:57.654790 17614 tablet_copy_service.cc:161] P 69ebcf1734b949a19671e604e9a54cec: Beginning new tablet copy session on tablet 5167aa62b10d4ad0a97d5388247ee1be from peer ce6c1f2801e84e869ab18938724e5aad at {username='slave'} at 127.0.0.1:41646: session id = ce6c1f2801e84e869ab18938724e5aad-5167aa62b10d4ad0a97d5388247ee1be
I20240503 08:12:57.657194 17614 tablet_copy_source_session.cc:205] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:12:57.658106 18278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5167aa62b10d4ad0a97d5388247ee1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:57.662590 18278 tablet_copy_client.cc:783] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 0 data blocks...
I20240503 08:12:57.662765 18278 tablet_copy_client.cc:647] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 1 WAL segments...
I20240503 08:12:57.664216 18278 tablet_copy_client.cc:523] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:12:57.666781 18278 tablet_bootstrap.cc:492] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad: Bootstrap starting.
I20240503 08:12:57.671700 18278 tablet_bootstrap.cc:492] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:12:57.672041 18278 tablet_bootstrap.cc:492] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad: Bootstrap complete.
I20240503 08:12:57.672271 18278 ts_tablet_manager.cc:1367] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad: Time spent bootstrapping tablet: real 0.006s user 0.007s sys 0.000s
I20240503 08:12:57.672865 18278 raft_consensus.cc:348] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:57.673085 18278 raft_consensus.cc:729] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce6c1f2801e84e869ab18938724e5aad, State: Initialized, Role: LEARNER
I20240503 08:12:57.673274 18278 consensus_queue.cc:260] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:57.674263 18278 ts_tablet_manager.cc:1398] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 08:12:57.674942 17614 tablet_copy_service.cc:342] P 69ebcf1734b949a19671e604e9a54cec: Request end of tablet copy session ce6c1f2801e84e869ab18938724e5aad-5167aa62b10d4ad0a97d5388247ee1be received from {username='slave'} at 127.0.0.1:41646
I20240503 08:12:57.675031 17614 tablet_copy_service.cc:433] P 69ebcf1734b949a19671e604e9a54cec: ending tablet copy session ce6c1f2801e84e869ab18938724e5aad-5167aa62b10d4ad0a97d5388247ee1be on tablet 5167aa62b10d4ad0a97d5388247ee1be with peer ce6c1f2801e84e869ab18938724e5aad
I20240503 08:12:57.694876 18278 ts_tablet_manager.cc:902] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725)
I20240503 08:12:57.696028 18278 tablet_copy_client.cc:308] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Beginning tablet copy session from remote peer at address 127.16.10.65:41725
I20240503 08:12:57.696599 17539 tablet_copy_service.cc:140] P 06335016e7f84df18efcdfacbab289b2: Received BeginTabletCopySession request for tablet 519eb7f46c59460ba3b4a5613ff54894 from peer ce6c1f2801e84e869ab18938724e5aad ({username='slave'} at 127.0.0.1:54126)
I20240503 08:12:57.696730 17539 tablet_copy_service.cc:161] P 06335016e7f84df18efcdfacbab289b2: Beginning new tablet copy session on tablet 519eb7f46c59460ba3b4a5613ff54894 from peer ce6c1f2801e84e869ab18938724e5aad at {username='slave'} at 127.0.0.1:54126: session id = ce6c1f2801e84e869ab18938724e5aad-519eb7f46c59460ba3b4a5613ff54894
I20240503 08:12:57.699038 17539 tablet_copy_source_session.cc:205] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:12:57.700054 18278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 519eb7f46c59460ba3b4a5613ff54894. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:57.705513 18278 tablet_copy_client.cc:783] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 0 data blocks...
I20240503 08:12:57.705719 18278 tablet_copy_client.cc:647] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 1 WAL segments...
I20240503 08:12:57.707168 18278 tablet_copy_client.cc:523] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:12:57.709934 18278 tablet_bootstrap.cc:492] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap starting.
I20240503 08:12:57.715817 18278 tablet_bootstrap.cc:492] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:12:57.716126 18278 tablet_bootstrap.cc:492] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap complete.
I20240503 08:12:57.716364 18278 ts_tablet_manager.cc:1367] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.004s
I20240503 08:12:57.716950 18278 raft_consensus.cc:348] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:57.717136 18278 raft_consensus.cc:729] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce6c1f2801e84e869ab18938724e5aad, State: Initialized, Role: LEARNER
I20240503 08:12:57.717288 18278 consensus_queue.cc:260] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:57.718263 18278 ts_tablet_manager.cc:1398] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:57.719616 17539 tablet_copy_service.cc:342] P 06335016e7f84df18efcdfacbab289b2: Request end of tablet copy session ce6c1f2801e84e869ab18938724e5aad-519eb7f46c59460ba3b4a5613ff54894 received from {username='slave'} at 127.0.0.1:54126
I20240503 08:12:57.719712 17539 tablet_copy_service.cc:433] P 06335016e7f84df18efcdfacbab289b2: ending tablet copy session ce6c1f2801e84e869ab18938724e5aad-519eb7f46c59460ba3b4a5613ff54894 on tablet 519eb7f46c59460ba3b4a5613ff54894 with peer ce6c1f2801e84e869ab18938724e5aad
I20240503 08:12:57.721280 18278 ts_tablet_manager.cc:902] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725)
I20240503 08:12:57.722764 18278 tablet_copy_client.cc:308] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Beginning tablet copy session from remote peer at address 127.16.10.65:41725
I20240503 08:12:57.723347 17539 tablet_copy_service.cc:140] P 06335016e7f84df18efcdfacbab289b2: Received BeginTabletCopySession request for tablet 5f95209235434aa0aa22bb6fff89bbb5 from peer ce6c1f2801e84e869ab18938724e5aad ({username='slave'} at 127.0.0.1:54126)
I20240503 08:12:57.723538 17539 tablet_copy_service.cc:161] P 06335016e7f84df18efcdfacbab289b2: Beginning new tablet copy session on tablet 5f95209235434aa0aa22bb6fff89bbb5 from peer ce6c1f2801e84e869ab18938724e5aad at {username='slave'} at 127.0.0.1:54126: session id = ce6c1f2801e84e869ab18938724e5aad-5f95209235434aa0aa22bb6fff89bbb5
I20240503 08:12:57.725970 17539 tablet_copy_source_session.cc:205] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:12:57.727067 18278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f95209235434aa0aa22bb6fff89bbb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:57.740293 18278 tablet_copy_client.cc:783] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 0 data blocks...
I20240503 08:12:57.740525 18278 tablet_copy_client.cc:647] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 1 WAL segments...
I20240503 08:12:57.741781 18278 tablet_copy_client.cc:523] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:12:57.744315 18278 tablet_bootstrap.cc:492] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap starting.
I20240503 08:12:57.748838 18278 tablet_bootstrap.cc:492] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:12:57.749099 18278 tablet_bootstrap.cc:492] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap complete.
I20240503 08:12:57.749285 18278 ts_tablet_manager.cc:1367] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240503 08:12:57.749888 18278 raft_consensus.cc:348] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:57.750123 18278 raft_consensus.cc:729] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce6c1f2801e84e869ab18938724e5aad, State: Initialized, Role: LEARNER
I20240503 08:12:57.750305 18278 consensus_queue.cc:260] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:57.750720 18278 ts_tablet_manager.cc:1398] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:12:57.751281 17539 tablet_copy_service.cc:342] P 06335016e7f84df18efcdfacbab289b2: Request end of tablet copy session ce6c1f2801e84e869ab18938724e5aad-5f95209235434aa0aa22bb6fff89bbb5 received from {username='slave'} at 127.0.0.1:54126
I20240503 08:12:57.751379 17539 tablet_copy_service.cc:433] P 06335016e7f84df18efcdfacbab289b2: ending tablet copy session ce6c1f2801e84e869ab18938724e5aad-5f95209235434aa0aa22bb6fff89bbb5 on tablet 5f95209235434aa0aa22bb6fff89bbb5 with peer ce6c1f2801e84e869ab18938724e5aad
I20240503 08:12:57.753623 18278 ts_tablet_manager.cc:902] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725)
I20240503 08:12:57.755864 18278 tablet_copy_client.cc:308] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Beginning tablet copy session from remote peer at address 127.16.10.65:41725
I20240503 08:12:57.756367 17539 tablet_copy_service.cc:140] P 06335016e7f84df18efcdfacbab289b2: Received BeginTabletCopySession request for tablet db0fbf6819374978ab404bbfde4b9d42 from peer ce6c1f2801e84e869ab18938724e5aad ({username='slave'} at 127.0.0.1:54126)
I20240503 08:12:57.756469 17539 tablet_copy_service.cc:161] P 06335016e7f84df18efcdfacbab289b2: Beginning new tablet copy session on tablet db0fbf6819374978ab404bbfde4b9d42 from peer ce6c1f2801e84e869ab18938724e5aad at {username='slave'} at 127.0.0.1:54126: session id = ce6c1f2801e84e869ab18938724e5aad-db0fbf6819374978ab404bbfde4b9d42
I20240503 08:12:57.758646 17539 tablet_copy_source_session.cc:205] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:12:57.759619 18278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db0fbf6819374978ab404bbfde4b9d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:12:57.764492 18278 tablet_copy_client.cc:783] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 0 data blocks...
I20240503 08:12:57.764672 18278 tablet_copy_client.cc:647] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 1 WAL segments...
I20240503 08:12:57.766219 18278 tablet_copy_client.cc:523] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:12:57.768666 18278 tablet_bootstrap.cc:492] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap starting.
I20240503 08:12:57.774103 18278 tablet_bootstrap.cc:492] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:12:57.774480 18278 tablet_bootstrap.cc:492] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap complete.
I20240503 08:12:57.774741 18278 ts_tablet_manager.cc:1367] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.002s
I20240503 08:12:57.775460 18278 raft_consensus.cc:348] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:57.775637 18278 raft_consensus.cc:729] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce6c1f2801e84e869ab18938724e5aad, State: Initialized, Role: LEARNER
I20240503 08:12:57.775804 18278 consensus_queue.cc:260] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:12:57.776360 18278 ts_tablet_manager.cc:1398] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:12:57.787953 17539 tablet_copy_service.cc:342] P 06335016e7f84df18efcdfacbab289b2: Request end of tablet copy session ce6c1f2801e84e869ab18938724e5aad-db0fbf6819374978ab404bbfde4b9d42 received from {username='slave'} at 127.0.0.1:54126
I20240503 08:12:57.788090 17539 tablet_copy_service.cc:433] P 06335016e7f84df18efcdfacbab289b2: ending tablet copy session ce6c1f2801e84e869ab18938724e5aad-db0fbf6819374978ab404bbfde4b9d42 on tablet db0fbf6819374978ab404bbfde4b9d42 with peer ce6c1f2801e84e869ab18938724e5aad
I20240503 08:12:58.025333 18151 raft_consensus.cc:1203] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:12:58.125434 18151 raft_consensus.cc:1203] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:12:58.159284 18151 raft_consensus.cc:1203] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:12:58.338097 18151 raft_consensus.cc:1203] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:12:58.607249 18301 raft_consensus.cc:1050] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2: attempting to promote NON_VOTER ce6c1f2801e84e869ab18938724e5aad to VOTER
I20240503 08:12:58.608006 18301 consensus_queue.cc:237] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:58.609956 18151 raft_consensus.cc:1261] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:58.609972 17678 raft_consensus.cc:1261] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:58.610394 18231 consensus_queue.cc:1035] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:58.610778 18304 consensus_queue.cc:1035] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:58.613606 17602 raft_consensus.cc:1261] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:58.614132 18301 consensus_queue.cc:1035] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:58.614668 18231 raft_consensus.cc:2932] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.615262 17677 raft_consensus.cc:2932] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.615659 17602 raft_consensus.cc:2932] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.621217 18151 raft_consensus.cc:2932] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.621774 17424 catalog_manager.cc:5484] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:58.628808 18304 raft_consensus.cc:1050] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2: attempting to promote NON_VOTER ce6c1f2801e84e869ab18938724e5aad to VOTER
I20240503 08:12:58.629494 18304 consensus_queue.cc:237] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:58.631179 18151 raft_consensus.cc:1261] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:58.631305 17677 raft_consensus.cc:1261] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:58.631734 18301 consensus_queue.cc:1035] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:58.631966 18309 consensus_queue.cc:1035] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:58.633170 17602 raft_consensus.cc:1261] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:58.634088 18304 consensus_queue.cc:1035] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:58.636410 18301 raft_consensus.cc:2932] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.637109 18151 raft_consensus.cc:2932] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.637817 17602 raft_consensus.cc:2932] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.641069 17677 raft_consensus.cc:2932] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.642659 17426 catalog_manager.cc:5484] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:12:58.644201 18303 raft_consensus.cc:1050] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec: attempting to promote NON_VOTER ce6c1f2801e84e869ab18938724e5aad to VOTER
I20240503 08:12:58.644920 18303 consensus_queue.cc:237] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:58.653250 17525 raft_consensus.cc:1261] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:58.653347 17677 raft_consensus.cc:1261] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:58.653738 18319 consensus_queue.cc:1035] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:58.654198 18303 consensus_queue.cc:1035] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:58.658540 18151 raft_consensus.cc:1261] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:58.659087 17524 consensus_queue.cc:237] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:58.660686 18302 consensus_queue.cc:1035] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:58.661360 18150 raft_consensus.cc:1261] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:58.662050 17678 raft_consensus.cc:1261] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:58.662448 18304 consensus_queue.cc:1035] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:58.662873 18309 consensus_queue.cc:1035] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:58.665066 18303 raft_consensus.cc:2932] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.665819 18301 raft_consensus.cc:2932] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.666555 17675 raft_consensus.cc:2932] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.666556 18148 raft_consensus.cc:2932] T 519eb7f46c59460ba3b4a5613ff54894 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.669420 17411 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 519eb7f46c59460ba3b4a5613ff54894 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:12:58.671316 17529 raft_consensus.cc:2932] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.672171 17425 catalog_manager.cc:5484] T 519eb7f46c59460ba3b4a5613ff54894 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:12:58.674319 17427 catalog_manager.cc:5484] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec reported cstate change: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240503 08:12:58.675760 17586 tablet_service.cc:1514] Processing DeleteTablet for tablet 519eb7f46c59460ba3b4a5613ff54894 with delete_type TABLET_DATA_TOMBSTONED (TS 69ebcf1734b949a19671e604e9a54cec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41608
I20240503 08:12:58.686242 18323 tablet_replica.cc:330] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec: stopping tablet replica
I20240503 08:12:58.686820 17677 raft_consensus.cc:2932] T 519eb7f46c59460ba3b4a5613ff54894 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.686758 18150 raft_consensus.cc:2932] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.689659 18323 raft_consensus.cc:2229] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:58.689957 18323 raft_consensus.cc:2258] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:58.691597 18323 ts_tablet_manager.cc:1875] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:12:58.696136 17604 consensus_queue.cc:237] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:58.698097 18150 raft_consensus.cc:1261] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:58.699223 17677 raft_consensus.cc:1261] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:58.699105 18303 consensus_queue.cc:1035] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20240503 08:12:58.701651 18323 ts_tablet_manager.cc:1888] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:12:58.701027 18319 consensus_queue.cc:1035] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20240503 08:12:58.701874 18323 log.cc:1196] T 519eb7f46c59460ba3b4a5613ff54894 P 69ebcf1734b949a19671e604e9a54cec: Deleting WAL directory at /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-1-root/wals/519eb7f46c59460ba3b4a5613ff54894
I20240503 08:12:58.702876 17414 catalog_manager.cc:4830] TS 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): tablet 519eb7f46c59460ba3b4a5613ff54894 (table test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]) successfully deleted
I20240503 08:12:58.704471 18150 raft_consensus.cc:2932] T 5167aa62b10d4ad0a97d5388247ee1be P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.704916 17677 raft_consensus.cc:2932] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.703876 18303 raft_consensus.cc:2932] T 5167aa62b10d4ad0a97d5388247ee1be P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.709640 17424 catalog_manager.cc:5484] T 5167aa62b10d4ad0a97d5388247ee1be P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.710724 17414 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 5167aa62b10d4ad0a97d5388247ee1be with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:12:58.713743 17512 tablet_service.cc:1514] Processing DeleteTablet for tablet 5167aa62b10d4ad0a97d5388247ee1be with delete_type TABLET_DATA_TOMBSTONED (TS 06335016e7f84df18efcdfacbab289b2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54090
I20240503 08:12:58.719782 18324 tablet_replica.cc:330] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2: stopping tablet replica
I20240503 08:12:58.719980 18324 raft_consensus.cc:2229] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:58.720213 18324 raft_consensus.cc:2258] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:58.720909 18324 ts_tablet_manager.cc:1875] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:12:58.725476 18324 ts_tablet_manager.cc:1888] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:12:58.725562 18324 log.cc:1196] T 5167aa62b10d4ad0a97d5388247ee1be P 06335016e7f84df18efcdfacbab289b2: Deleting WAL directory at /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-0-root/wals/5167aa62b10d4ad0a97d5388247ee1be
I20240503 08:12:58.726115 17411 catalog_manager.cc:4830] TS 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): tablet 5167aa62b10d4ad0a97d5388247ee1be (table test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]) successfully deleted
I20240503 08:12:58.942029 18304 raft_consensus.cc:1050] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2: attempting to promote NON_VOTER ce6c1f2801e84e869ab18938724e5aad to VOTER
I20240503 08:12:58.942729 18304 consensus_queue.cc:237] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:58.944662 17602 raft_consensus.cc:1261] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:58.944662 17677 raft_consensus.cc:1261] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:58.944815 18150 raft_consensus.cc:1261] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:12:58.945312 18309 consensus_queue.cc:1035] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:58.945804 18301 consensus_queue.cc:1035] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:58.946048 18231 consensus_queue.cc:1035] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:12:58.956737 18301 raft_consensus.cc:2932] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.961777 17675 raft_consensus.cc:2932] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.965451 17425 catalog_manager.cc:5484] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:12:58.965457 18150 raft_consensus.cc:2932] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.970328 17524 consensus_queue.cc:237] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:58.964486 17602 raft_consensus.cc:2932] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.972177 17675 raft_consensus.cc:1261] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:58.972743 18150 raft_consensus.cc:1261] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:58.972712 18301 consensus_queue.cc:1035] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:58.973140 18309 consensus_queue.cc:1035] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:58.974838 18309 raft_consensus.cc:2932] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.978721 17411 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet db0fbf6819374978ab404bbfde4b9d42 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:12:58.978503 18150 raft_consensus.cc:2932] T db0fbf6819374978ab404bbfde4b9d42 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.979797 17675 raft_consensus.cc:2932] T db0fbf6819374978ab404bbfde4b9d42 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:58.980942 17427 catalog_manager.cc:5484] T db0fbf6819374978ab404bbfde4b9d42 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:12:58.984099 17586 tablet_service.cc:1514] Processing DeleteTablet for tablet db0fbf6819374978ab404bbfde4b9d42 with delete_type TABLET_DATA_TOMBSTONED (TS 69ebcf1734b949a19671e604e9a54cec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41608
I20240503 08:12:58.984416 18323 tablet_replica.cc:330] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec: stopping tablet replica
I20240503 08:12:58.984606 18323 raft_consensus.cc:2229] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:58.984779 18323 raft_consensus.cc:2258] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:58.985730 18323 ts_tablet_manager.cc:1875] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:12:58.990779 18323 ts_tablet_manager.cc:1888] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:12:58.990890 18323 log.cc:1196] T db0fbf6819374978ab404bbfde4b9d42 P 69ebcf1734b949a19671e604e9a54cec: Deleting WAL directory at /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-1-root/wals/db0fbf6819374978ab404bbfde4b9d42
I20240503 08:12:58.991533 17414 catalog_manager.cc:4830] TS 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): tablet db0fbf6819374978ab404bbfde4b9d42 (table test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]) successfully deleted
I20240503 08:12:59.128425 17525 consensus_queue.cc:237] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:12:59.129882 18150 raft_consensus.cc:1261] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:59.130362 18231 consensus_queue.cc:1035] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:59.130496 17604 raft_consensus.cc:1261] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:12:59.130973 18231 consensus_queue.cc:1035] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:12:59.132637 18301 raft_consensus.cc:2932] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:59.137797 17411 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 5f95209235434aa0aa22bb6fff89bbb5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:12:59.138470 18150 raft_consensus.cc:2932] T 5f95209235434aa0aa22bb6fff89bbb5 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:59.141084 17425 catalog_manager.cc:5484] T 5f95209235434aa0aa22bb6fff89bbb5 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:12:59.142870 17604 raft_consensus.cc:2932] T 5f95209235434aa0aa22bb6fff89bbb5 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:12:59.145910 17668 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f95209235434aa0aa22bb6fff89bbb5 with delete_type TABLET_DATA_TOMBSTONED (TS 0d15e9450254455f8e3a1d2b194661a2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34844
I20240503 08:12:59.155716 18329 tablet_replica.cc:330] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2: stopping tablet replica
I20240503 08:12:59.155921 18329 raft_consensus.cc:2229] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:12:59.156167 18329 raft_consensus.cc:2258] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:12:59.157012 18329 ts_tablet_manager.cc:1875] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:12:59.161325 18329 ts_tablet_manager.cc:1888] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:12:59.161439 18329 log.cc:1196] T 5f95209235434aa0aa22bb6fff89bbb5 P 0d15e9450254455f8e3a1d2b194661a2: Deleting WAL directory at /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-2-root/wals/5f95209235434aa0aa22bb6fff89bbb5
I20240503 08:12:59.162107 17412 catalog_manager.cc:4830] TS 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): tablet 5f95209235434aa0aa22bb6fff89bbb5 (table test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]) successfully deleted
I20240503 08:13:00.158457 17604 consensus_queue.cc:237] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:00.160534 17677 raft_consensus.cc:1261] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:00.160673 17525 raft_consensus.cc:1261] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:00.161079 18331 consensus_queue.cc:1035] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240503 08:13:00.161403 17570 consensus_peers.cc:485] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbcdd1b33ca34becb52d034d7b9f3dcd. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:13:00.161442 18333 consensus_queue.cc:1035] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:13:00.163892 18331 raft_consensus.cc:2932] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.164530 17677 raft_consensus.cc:2932] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.168129 17525 raft_consensus.cc:2932] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.170843 17427 catalog_manager.cc:5484] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:13:00.172334 17677 consensus_queue.cc:237] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
W20240503 08:13:00.176882 17644 consensus_peers.cc:485] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06c8a838b19a469ea44e7050f78bf375. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:13:00.176699 17525 raft_consensus.cc:1261] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:00.177520 17604 raft_consensus.cc:1261] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:00.177572 18259 consensus_queue.cc:1035] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:13:00.177976 17746 consensus_queue.cc:1035] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:13:00.180737 17746 raft_consensus.cc:2932] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.184190 17525 raft_consensus.cc:2932] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.184878 17604 raft_consensus.cc:2932] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.189836 17424 catalog_manager.cc:5484] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:13:00.189952 17677 consensus_queue.cc:237] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:00.196461 17524 raft_consensus.cc:1261] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 08:13:00.196635 17644 consensus_peers.cc:485] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 675688b228f147f8a88e69f43b91ef0c. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:13:00.196677 17604 raft_consensus.cc:1261] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:00.196945 17746 consensus_queue.cc:1035] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:13:00.197391 18259 consensus_queue.cc:1035] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:13:00.199239 18259 raft_consensus.cc:2932] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.199937 17524 raft_consensus.cc:2932] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.203610 17604 raft_consensus.cc:2932] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.204155 17602 consensus_queue.cc:237] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:00.205744 17425 catalog_manager.cc:5484] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.206634 17524 raft_consensus.cc:1261] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:00.206818 17677 raft_consensus.cc:1261] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:00.207082 18333 consensus_queue.cc:1035] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:13:00.207826 18333 consensus_queue.cc:1035] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240503 08:13:00.208477 17570 consensus_peers.cc:485] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70e5b64ee81948b0a2ed2bbb648730bf. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:13:00.211380 18331 raft_consensus.cc:2932] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.212082 17525 raft_consensus.cc:2932] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.216591 17425 catalog_manager.cc:5484] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:13:00.221566 17677 raft_consensus.cc:2932] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:00.625957 18351 ts_tablet_manager.cc:902] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:13:00.627593 18351 tablet_copy_client.cc:308] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Beginning tablet copy session from remote peer at address 127.16.10.67:45843
I20240503 08:13:00.628137 17688 tablet_copy_service.cc:140] P 0d15e9450254455f8e3a1d2b194661a2: Received BeginTabletCopySession request for tablet 675688b228f147f8a88e69f43b91ef0c from peer ce6c1f2801e84e869ab18938724e5aad ({username='slave'} at 127.0.0.1:34862)
I20240503 08:13:00.628245 17688 tablet_copy_service.cc:161] P 0d15e9450254455f8e3a1d2b194661a2: Beginning new tablet copy session on tablet 675688b228f147f8a88e69f43b91ef0c from peer ce6c1f2801e84e869ab18938724e5aad at {username='slave'} at 127.0.0.1:34862: session id = ce6c1f2801e84e869ab18938724e5aad-675688b228f147f8a88e69f43b91ef0c
I20240503 08:13:00.630124 17688 tablet_copy_source_session.cc:205] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:13:00.631328 18351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 675688b228f147f8a88e69f43b91ef0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:13:00.636943 18351 tablet_copy_client.cc:783] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 0 data blocks...
I20240503 08:13:00.637245 18351 tablet_copy_client.cc:647] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 1 WAL segments...
I20240503 08:13:00.638760 18351 tablet_copy_client.cc:523] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:13:00.642042 18351 tablet_bootstrap.cc:492] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad: Bootstrap starting.
I20240503 08:13:00.647825 18351 tablet_bootstrap.cc:492] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:13:00.648492 18351 tablet_bootstrap.cc:492] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad: Bootstrap complete.
I20240503 08:13:00.648726 18351 ts_tablet_manager.cc:1367] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad: Time spent bootstrapping tablet: real 0.007s user 0.008s sys 0.000s
I20240503 08:13:00.649400 18351 raft_consensus.cc:348] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:00.649567 18351 raft_consensus.cc:729] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce6c1f2801e84e869ab18938724e5aad, State: Initialized, Role: LEARNER
I20240503 08:13:00.649722 18351 consensus_queue.cc:260] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:00.650420 18351 ts_tablet_manager.cc:1398] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 08:13:00.650991 17688 tablet_copy_service.cc:342] P 0d15e9450254455f8e3a1d2b194661a2: Request end of tablet copy session ce6c1f2801e84e869ab18938724e5aad-675688b228f147f8a88e69f43b91ef0c received from {username='slave'} at 127.0.0.1:34862
I20240503 08:13:00.651093 17688 tablet_copy_service.cc:433] P 0d15e9450254455f8e3a1d2b194661a2: ending tablet copy session ce6c1f2801e84e869ab18938724e5aad-675688b228f147f8a88e69f43b91ef0c on tablet 675688b228f147f8a88e69f43b91ef0c with peer ce6c1f2801e84e869ab18938724e5aad
I20240503 08:13:00.680327 18351 ts_tablet_manager.cc:902] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:13:00.682371 18351 tablet_copy_client.cc:308] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Beginning tablet copy session from remote peer at address 127.16.10.66:39107
I20240503 08:13:00.682961 17614 tablet_copy_service.cc:140] P 69ebcf1734b949a19671e604e9a54cec: Received BeginTabletCopySession request for tablet 70e5b64ee81948b0a2ed2bbb648730bf from peer ce6c1f2801e84e869ab18938724e5aad ({username='slave'} at 127.0.0.1:41646)
I20240503 08:13:00.683097 17614 tablet_copy_service.cc:161] P 69ebcf1734b949a19671e604e9a54cec: Beginning new tablet copy session on tablet 70e5b64ee81948b0a2ed2bbb648730bf from peer ce6c1f2801e84e869ab18938724e5aad at {username='slave'} at 127.0.0.1:41646: session id = ce6c1f2801e84e869ab18938724e5aad-70e5b64ee81948b0a2ed2bbb648730bf
I20240503 08:13:00.685585 17614 tablet_copy_source_session.cc:205] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:13:00.686637 18351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e5b64ee81948b0a2ed2bbb648730bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:13:00.691994 18351 tablet_copy_client.cc:783] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 0 data blocks...
I20240503 08:13:00.692265 18351 tablet_copy_client.cc:647] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 1 WAL segments...
I20240503 08:13:00.693789 18351 tablet_copy_client.cc:523] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:13:00.696307 18362 ts_tablet_manager.cc:902] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
I20240503 08:13:00.697101 18351 tablet_bootstrap.cc:492] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad: Bootstrap starting.
I20240503 08:13:00.707021 18362 tablet_copy_client.cc:308] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Beginning tablet copy session from remote peer at address 127.16.10.66:39107
I20240503 08:13:00.708074 17614 tablet_copy_service.cc:140] P 69ebcf1734b949a19671e604e9a54cec: Received BeginTabletCopySession request for tablet bbcdd1b33ca34becb52d034d7b9f3dcd from peer ce6c1f2801e84e869ab18938724e5aad ({username='slave'} at 127.0.0.1:41646)
I20240503 08:13:00.708204 17614 tablet_copy_service.cc:161] P 69ebcf1734b949a19671e604e9a54cec: Beginning new tablet copy session on tablet bbcdd1b33ca34becb52d034d7b9f3dcd from peer ce6c1f2801e84e869ab18938724e5aad at {username='slave'} at 127.0.0.1:41646: session id = ce6c1f2801e84e869ab18938724e5aad-bbcdd1b33ca34becb52d034d7b9f3dcd
I20240503 08:13:00.708822 18351 tablet_bootstrap.cc:492] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:13:00.709066 18351 tablet_bootstrap.cc:492] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad: Bootstrap complete.
I20240503 08:13:00.709235 18351 ts_tablet_manager.cc:1367] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20240503 08:13:00.709769 18351 raft_consensus.cc:348] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:00.709947 18351 raft_consensus.cc:729] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce6c1f2801e84e869ab18938724e5aad, State: Initialized, Role: LEARNER
I20240503 08:13:00.710067 18351 consensus_queue.cc:260] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:00.710501 18351 ts_tablet_manager.cc:1398] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 08:13:00.711002 17614 tablet_copy_source_session.cc:205] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:13:00.711459 17613 tablet_copy_service.cc:342] P 69ebcf1734b949a19671e604e9a54cec: Request end of tablet copy session ce6c1f2801e84e869ab18938724e5aad-70e5b64ee81948b0a2ed2bbb648730bf received from {username='slave'} at 127.0.0.1:41646
I20240503 08:13:00.711563 17613 tablet_copy_service.cc:433] P 69ebcf1734b949a19671e604e9a54cec: ending tablet copy session ce6c1f2801e84e869ab18938724e5aad-70e5b64ee81948b0a2ed2bbb648730bf on tablet 70e5b64ee81948b0a2ed2bbb648730bf with peer ce6c1f2801e84e869ab18938724e5aad
I20240503 08:13:00.713161 18362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbcdd1b33ca34becb52d034d7b9f3dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:13:00.719012 18362 tablet_copy_client.cc:783] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 0 data blocks...
I20240503 08:13:00.719259 18362 tablet_copy_client.cc:647] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 1 WAL segments...
I20240503 08:13:00.721588 18362 tablet_copy_client.cc:523] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:13:00.724491 18362 tablet_bootstrap.cc:492] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad: Bootstrap starting.
I20240503 08:13:00.729926 18362 tablet_bootstrap.cc:492] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:13:00.730254 18362 tablet_bootstrap.cc:492] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad: Bootstrap complete.
I20240503 08:13:00.730459 18362 ts_tablet_manager.cc:1367] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240503 08:13:00.731043 18362 raft_consensus.cc:348] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:00.731252 18362 raft_consensus.cc:729] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce6c1f2801e84e869ab18938724e5aad, State: Initialized, Role: LEARNER
I20240503 08:13:00.731464 18362 consensus_queue.cc:260] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:00.731994 18362 ts_tablet_manager.cc:1398] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad: Time spent starting tablet: real 0.001s user 0.000s sys 0.003s
I20240503 08:13:00.732653 17613 tablet_copy_service.cc:342] P 69ebcf1734b949a19671e604e9a54cec: Request end of tablet copy session ce6c1f2801e84e869ab18938724e5aad-bbcdd1b33ca34becb52d034d7b9f3dcd received from {username='slave'} at 127.0.0.1:41646
I20240503 08:13:00.732762 17613 tablet_copy_service.cc:433] P 69ebcf1734b949a19671e604e9a54cec: ending tablet copy session ce6c1f2801e84e869ab18938724e5aad-bbcdd1b33ca34becb52d034d7b9f3dcd on tablet bbcdd1b33ca34becb52d034d7b9f3dcd with peer ce6c1f2801e84e869ab18938724e5aad
I20240503 08:13:00.767341 18362 ts_tablet_manager.cc:902] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843)
I20240503 08:13:00.768800 18362 tablet_copy_client.cc:308] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Beginning tablet copy session from remote peer at address 127.16.10.67:45843
I20240503 08:13:00.769430 17688 tablet_copy_service.cc:140] P 0d15e9450254455f8e3a1d2b194661a2: Received BeginTabletCopySession request for tablet 06c8a838b19a469ea44e7050f78bf375 from peer ce6c1f2801e84e869ab18938724e5aad ({username='slave'} at 127.0.0.1:34862)
I20240503 08:13:00.769642 17688 tablet_copy_service.cc:161] P 0d15e9450254455f8e3a1d2b194661a2: Beginning new tablet copy session on tablet 06c8a838b19a469ea44e7050f78bf375 from peer ce6c1f2801e84e869ab18938724e5aad at {username='slave'} at 127.0.0.1:34862: session id = ce6c1f2801e84e869ab18938724e5aad-06c8a838b19a469ea44e7050f78bf375
I20240503 08:13:00.772248 17688 tablet_copy_source_session.cc:205] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 08:13:00.773469 18362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06c8a838b19a469ea44e7050f78bf375. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 08:13:00.778887 18362 tablet_copy_client.cc:783] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 0 data blocks...
I20240503 08:13:00.779105 18362 tablet_copy_client.cc:647] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Starting download of 1 WAL segments...
I20240503 08:13:00.780789 18362 tablet_copy_client.cc:523] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 08:13:00.784132 18362 tablet_bootstrap.cc:492] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap starting.
I20240503 08:13:00.790210 18362 tablet_bootstrap.cc:492] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 08:13:00.790549 18362 tablet_bootstrap.cc:492] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad: Bootstrap complete.
I20240503 08:13:00.790752 18362 ts_tablet_manager.cc:1367] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s
I20240503 08:13:00.791339 18362 raft_consensus.cc:348] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:00.791602 18362 raft_consensus.cc:729] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce6c1f2801e84e869ab18938724e5aad, State: Initialized, Role: LEARNER
I20240503 08:13:00.791812 18362 consensus_queue.cc:260] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:00.792330 18362 ts_tablet_manager.cc:1398] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 08:13:00.793148 17688 tablet_copy_service.cc:342] P 0d15e9450254455f8e3a1d2b194661a2: Request end of tablet copy session ce6c1f2801e84e869ab18938724e5aad-06c8a838b19a469ea44e7050f78bf375 received from {username='slave'} at 127.0.0.1:34862
I20240503 08:13:00.793277 17688 tablet_copy_service.cc:433] P 0d15e9450254455f8e3a1d2b194661a2: ending tablet copy session ce6c1f2801e84e869ab18938724e5aad-06c8a838b19a469ea44e7050f78bf375 on tablet 06c8a838b19a469ea44e7050f78bf375 with peer ce6c1f2801e84e869ab18938724e5aad
I20240503 08:13:01.012362 18151 raft_consensus.cc:1203] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:13:01.153050 18151 raft_consensus.cc:1203] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:13:01.191591 18151 raft_consensus.cc:1203] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:13:01.241487 18151 raft_consensus.cc:1203] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 08:13:01.633266 17746 raft_consensus.cc:1050] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2: attempting to promote NON_VOTER ce6c1f2801e84e869ab18938724e5aad to VOTER
I20240503 08:13:01.634022 17746 consensus_queue.cc:237] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:13:01.644631 18150 raft_consensus.cc:1261] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:13:01.645104 18377 consensus_queue.cc:1035] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:13:01.645274 17604 raft_consensus.cc:1261] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:13:01.645496 17525 raft_consensus.cc:1261] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:13:01.646485 17746 consensus_queue.cc:1035] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:13:01.646719 18377 consensus_queue.cc:1035] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:13:01.661231 18377 raft_consensus.cc:2932] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.662220 18150 raft_consensus.cc:2932] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.663430 17602 raft_consensus.cc:2932] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.666945 17525 raft_consensus.cc:2932] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.669750 17424 catalog_manager.cc:5484] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:13:01.687793 17675 consensus_queue.cc:237] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:13:01.690074 17603 raft_consensus.cc:1261] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:13:01.690622 17746 consensus_queue.cc:1035] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:13:01.691099 18150 raft_consensus.cc:1261] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:13:01.691939 17746 consensus_queue.cc:1035] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:13:01.694449 18259 raft_consensus.cc:2932] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.695366 18150 raft_consensus.cc:2932] T 675688b228f147f8a88e69f43b91ef0c P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.695483 17603 raft_consensus.cc:2932] T 675688b228f147f8a88e69f43b91ef0c P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.698566 17412 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 675688b228f147f8a88e69f43b91ef0c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:13:01.703238 17426 catalog_manager.cc:5484] T 675688b228f147f8a88e69f43b91ef0c P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: config changed from index 3 to 4, VOTER 06335016e7f84df18efcdfacbab289b2 (127.16.10.65) evicted. New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:13:01.706619 18331 raft_consensus.cc:1050] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec: attempting to promote NON_VOTER ce6c1f2801e84e869ab18938724e5aad to VOTER
I20240503 08:13:01.707438 18331 consensus_queue.cc:237] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:13:01.709975 17512 tablet_service.cc:1514] Processing DeleteTablet for tablet 675688b228f147f8a88e69f43b91ef0c with delete_type TABLET_DATA_TOMBSTONED (TS 06335016e7f84df18efcdfacbab289b2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54090
I20240503 08:13:01.712846 18150 raft_consensus.cc:1261] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:13:01.713148 17525 raft_consensus.cc:1261] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:13:01.713496 17675 raft_consensus.cc:1261] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:13:01.713681 18375 consensus_queue.cc:1035] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:13:01.713954 18331 consensus_queue.cc:1035] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:13:01.714493 18375 consensus_queue.cc:1035] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:13:01.720582 17746 raft_consensus.cc:1050] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2: attempting to promote NON_VOTER ce6c1f2801e84e869ab18938724e5aad to VOTER
I20240503 08:13:01.721359 17746 consensus_queue.cc:237] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:13:01.723304 18386 tablet_replica.cc:330] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2: stopping tablet replica
I20240503 08:13:01.723642 18386 raft_consensus.cc:2229] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:13:01.724014 18386 raft_consensus.cc:2258] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:13:01.726068 18386 ts_tablet_manager.cc:1875] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:13:01.728020 18375 raft_consensus.cc:2932] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.729717 17677 raft_consensus.cc:2932] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.733857 18151 raft_consensus.cc:2932] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.736428 18331 raft_consensus.cc:1050] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec: attempting to promote NON_VOTER ce6c1f2801e84e869ab18938724e5aad to VOTER
I20240503 08:13:01.737246 17427 catalog_manager.cc:5484] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.737262 18331 consensus_queue.cc:237] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:13:01.739944 17525 raft_consensus.cc:2932] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.744496 18151 raft_consensus.cc:1261] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:13:01.745154 18375 consensus_queue.cc:1035] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:13:01.745568 17603 raft_consensus.cc:1261] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:13:01.745893 17529 raft_consensus.cc:1261] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:13:01.745978 17524 raft_consensus.cc:1261] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:13:01.746436 18259 consensus_queue.cc:1035] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:13:01.747439 18377 consensus_queue.cc:1035] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:13:01.748208 18375 consensus_queue.cc:1035] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:13:01.748354 18151 raft_consensus.cc:1261] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad [term 1 LEARNER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:13:01.748821 18377 consensus_queue.cc:1035] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 08:13:01.759821 17604 consensus_queue.cc:237] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:13:01.761377 17675 raft_consensus.cc:1261] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 08:13:01.761873 18394 consensus_queue.cc:1035] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20240503 08:13:01.769624 18148 raft_consensus.cc:1261] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:13:01.770165 18394 consensus_queue.cc:1035] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:13:01.770802 18386 ts_tablet_manager.cc:1888] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:13:01.770921 18386 log.cc:1196] T 675688b228f147f8a88e69f43b91ef0c P 06335016e7f84df18efcdfacbab289b2: Deleting WAL directory at /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-0-root/wals/675688b228f147f8a88e69f43b91ef0c
I20240503 08:13:01.775194 17411 catalog_manager.cc:4830] TS 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725): tablet 675688b228f147f8a88e69f43b91ef0c (table test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]) successfully deleted
I20240503 08:13:01.781265 18394 raft_consensus.cc:2932] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.783087 18148 raft_consensus.cc:2932] T bbcdd1b33ca34becb52d034d7b9f3dcd P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.787145 17523 raft_consensus.cc:1261] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:13:01.788221 18331 consensus_queue.cc:1035] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:13:01.792305 17523 raft_consensus.cc:2932] T bbcdd1b33ca34becb52d034d7b9f3dcd P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.799077 17414 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet bbcdd1b33ca34becb52d034d7b9f3dcd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:13:01.801884 17425 catalog_manager.cc:5484] T bbcdd1b33ca34becb52d034d7b9f3dcd P 69ebcf1734b949a19671e604e9a54cec reported cstate change: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:13:01.807634 17668 tablet_service.cc:1514] Processing DeleteTablet for tablet bbcdd1b33ca34becb52d034d7b9f3dcd with delete_type TABLET_DATA_TOMBSTONED (TS 0d15e9450254455f8e3a1d2b194661a2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34844
I20240503 08:13:01.810405 18331 raft_consensus.cc:2932] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.815910 18259 raft_consensus.cc:2932] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.816567 17677 raft_consensus.cc:2932] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.819531 17426 catalog_manager.cc:5484] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec reported cstate change: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:13:01.818138 18151 raft_consensus.cc:2932] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.819602 18401 tablet_replica.cc:330] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2: stopping tablet replica
I20240503 08:13:01.824644 18401 raft_consensus.cc:2229] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:13:01.825805 18401 raft_consensus.cc:2258] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:13:01.826645 18401 ts_tablet_manager.cc:1875] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:13:01.818495 18150 raft_consensus.cc:2932] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.827525 17603 raft_consensus.cc:2932] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.833436 17427 catalog_manager.cc:5484] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:13:01.838186 17524 raft_consensus.cc:2932] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.843353 17529 raft_consensus.cc:2932] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.843907 17677 consensus_queue.cc:237] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:13:01.849737 17529 raft_consensus.cc:1261] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:13:01.850209 18259 consensus_queue.cc:1035] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:13:01.851096 18151 raft_consensus.cc:1261] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Refusing update from remote peer 0d15e9450254455f8e3a1d2b194661a2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:13:01.851796 18259 consensus_queue.cc:1035] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:13:01.852684 18259 raft_consensus.cc:2932] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.853734 17603 consensus_queue.cc:237] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } }
I20240503 08:13:01.855615 17529 raft_consensus.cc:2932] T 06c8a838b19a469ea44e7050f78bf375 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.855975 18151 raft_consensus.cc:1261] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:13:01.856336 17525 raft_consensus.cc:1261] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 08:13:01.856748 18375 consensus_queue.cc:1035] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:13:01.857004 18151 raft_consensus.cc:2932] T 06c8a838b19a469ea44e7050f78bf375 P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.857700 17412 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 06c8a838b19a469ea44e7050f78bf375 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:13:01.858155 18375 consensus_queue.cc:1035] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 08:13:01.860985 18375 raft_consensus.cc:2932] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.861390 17529 raft_consensus.cc:2932] T 70e5b64ee81948b0a2ed2bbb648730bf P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.862890 17426 catalog_manager.cc:5484] T 06c8a838b19a469ea44e7050f78bf375 P 0d15e9450254455f8e3a1d2b194661a2 reported cstate change: config changed from index 3 to 4, VOTER 69ebcf1734b949a19671e604e9a54cec (127.16.10.66) evicted. New cstate: current_term: 1 leader_uuid: "0d15e9450254455f8e3a1d2b194661a2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 08:13:01.865702 17414 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 70e5b64ee81948b0a2ed2bbb648730bf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 08:13:01.868083 18401 ts_tablet_manager.cc:1888] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:13:01.867877 17424 catalog_manager.cc:5484] T 70e5b64ee81948b0a2ed2bbb648730bf P 69ebcf1734b949a19671e604e9a54cec reported cstate change: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240503 08:13:01.868189 18401 log.cc:1196] T bbcdd1b33ca34becb52d034d7b9f3dcd P 0d15e9450254455f8e3a1d2b194661a2: Deleting WAL directory at /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-2-root/wals/bbcdd1b33ca34becb52d034d7b9f3dcd
I20240503 08:13:01.868899 17412 catalog_manager.cc:4830] TS 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): tablet bbcdd1b33ca34becb52d034d7b9f3dcd (table test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]) successfully deleted
I20240503 08:13:01.871611 17586 tablet_service.cc:1514] Processing DeleteTablet for tablet 06c8a838b19a469ea44e7050f78bf375 with delete_type TABLET_DATA_TOMBSTONED (TS 69ebcf1734b949a19671e604e9a54cec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41608
I20240503 08:13:01.872290 17668 tablet_service.cc:1514] Processing DeleteTablet for tablet 70e5b64ee81948b0a2ed2bbb648730bf with delete_type TABLET_DATA_TOMBSTONED (TS 0d15e9450254455f8e3a1d2b194661a2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34844
I20240503 08:13:01.870916 18150 raft_consensus.cc:2932] T 70e5b64ee81948b0a2ed2bbb648730bf P ce6c1f2801e84e869ab18938724e5aad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: false } } }
I20240503 08:13:01.872776 18401 tablet_replica.cc:330] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2: stopping tablet replica
I20240503 08:13:01.872972 18401 raft_consensus.cc:2229] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:13:01.873301 18401 raft_consensus.cc:2258] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:13:01.873322 18402 tablet_replica.cc:330] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec: stopping tablet replica
I20240503 08:13:01.873627 18402 raft_consensus.cc:2229] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 08:13:01.874367 18401 ts_tablet_manager.cc:1875] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:13:01.875867 18402 raft_consensus.cc:2258] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 08:13:01.877494 18402 ts_tablet_manager.cc:1875] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 08:13:01.883265 18401 ts_tablet_manager.cc:1888] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:13:01.883358 18401 log.cc:1196] T 70e5b64ee81948b0a2ed2bbb648730bf P 0d15e9450254455f8e3a1d2b194661a2: Deleting WAL directory at /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-2-root/wals/70e5b64ee81948b0a2ed2bbb648730bf
I20240503 08:13:01.883896 17412 catalog_manager.cc:4830] TS 0d15e9450254455f8e3a1d2b194661a2 (127.16.10.67:45843): tablet 70e5b64ee81948b0a2ed2bbb648730bf (table test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]) successfully deleted
I20240503 08:13:01.889720 18402 ts_tablet_manager.cc:1888] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 08:13:01.889854 18402 log.cc:1196] T 06c8a838b19a469ea44e7050f78bf375 P 69ebcf1734b949a19671e604e9a54cec: Deleting WAL directory at /tmp/dist-test-taskNOTvFw/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714723915676718-16425-0/minicluster-data/ts-1-root/wals/06c8a838b19a469ea44e7050f78bf375
I20240503 08:13:01.890616 17414 catalog_manager.cc:4830] TS 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107): tablet 06c8a838b19a469ea44e7050f78bf375 (table test-workload [id=e7e8a4e09e4f4fb4a9ccbef9a0e01643]) successfully deleted
I20240503 08:13:02.884689 17529 consensus_queue.cc:237] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:02.887367 17677 raft_consensus.cc:1261] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:02.887452 17603 raft_consensus.cc:1261] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:02.887857 18330 consensus_queue.cc:1035] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:13:02.888255 18231 consensus_queue.cc:1035] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240503 08:13:02.888471 17495 consensus_peers.cc:485] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7232c68b68b8434ea816445c62b9dcc7. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:13:02.891125 18231 raft_consensus.cc:2932] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:02.891590 17603 raft_consensus.cc:2932] T 7232c68b68b8434ea816445c62b9dcc7 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:02.891790 17677 raft_consensus.cc:2932] T 7232c68b68b8434ea816445c62b9dcc7 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:02.897887 17604 consensus_queue.cc:237] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:02.898468 17426 catalog_manager.cc:5484] T 7232c68b68b8434ea816445c62b9dcc7 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:13:02.902604 17677 raft_consensus.cc:1261] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:02.903085 17529 raft_consensus.cc:1261] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:02.903826 18387 consensus_queue.cc:1035] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:13:02.904141 18394 consensus_queue.cc:1035] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:13:02.907559 18394 raft_consensus.cc:2932] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:02.907996 17677 raft_consensus.cc:2932] T aa4e39d8646445ac80703d1a84bd1824 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
W20240503 08:13:02.921152 17570 consensus_peers.cc:485] T aa4e39d8646445ac80703d1a84bd1824 P 69ebcf1734b949a19671e604e9a54cec -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa4e39d8646445ac80703d1a84bd1824. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:13:02.921958 17529 raft_consensus.cc:2932] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:02.923782 17524 consensus_queue.cc:237] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:02.926798 17604 raft_consensus.cc:1261] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:02.926921 17677 raft_consensus.cc:1261] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 06335016e7f84df18efcdfacbab289b2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:02.927424 18404 consensus_queue.cc:1035] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240503 08:13:02.927695 17495 consensus_peers.cc:485] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56d3f2aacab848e2a887d16316b77932. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:13:02.927901 18407 consensus_queue.cc:1035] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:13:02.930859 18407 raft_consensus.cc:2932] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:02.932000 17604 raft_consensus.cc:2932] T 56d3f2aacab848e2a887d16316b77932 P 69ebcf1734b949a19671e604e9a54cec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:02.937584 17424 catalog_manager.cc:5484] T aa4e39d8646445ac80703d1a84bd1824 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } attrs { replace: true } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:02.940191 17603 consensus_queue.cc:237] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } }
I20240503 08:13:02.940737 17677 raft_consensus.cc:2932] T 56d3f2aacab848e2a887d16316b77932 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:02.943940 17529 raft_consensus.cc:1261] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:02.944705 17425 catalog_manager.cc:5484] T 56d3f2aacab848e2a887d16316b77932 P 06335016e7f84df18efcdfacbab289b2 reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "06335016e7f84df18efcdfacbab289b2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:13:02.946177 17675 raft_consensus.cc:1261] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Refusing update from remote peer 69ebcf1734b949a19671e604e9a54cec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 08:13:02.946667 18410 consensus_queue.cc:1035] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240503 08:13:02.947580 17570 consensus_peers.cc:485] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec -> Peer ce6c1f2801e84e869ab18938724e5aad (127.16.10.68:43291): Couldn't send request to peer ce6c1f2801e84e869ab18938724e5aad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd9674d047e34552a9142e4df2147730. This is attempt 1: this message will repeat every 5th retry.
I20240503 08:13:02.948638 18410 consensus_queue.cc:1035] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 08:13:02.949918 18411 raft_consensus.cc:2932] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:02.951284 17675 raft_consensus.cc:2932] T fd9674d047e34552a9142e4df2147730 P 0d15e9450254455f8e3a1d2b194661a2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:02.953217 17529 raft_consensus.cc:2932] T fd9674d047e34552a9142e4df2147730 P 06335016e7f84df18efcdfacbab289b2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } } }
I20240503 08:13:02.956379 17426 catalog_manager.cc:5484] T fd9674d047e34552a9142e4df2147730 P 69ebcf1734b949a19671e604e9a54cec reported cstate change: config changed from index -1 to 2, NON_VOTER ce6c1f2801e84e869ab18938724e5aad (127.16.10.68) added. New cstate: current_term: 1 leader_uuid: "69ebcf1734b949a19671e604e9a54cec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "06335016e7f84df18efcdfacbab289b2" member_type: VOTER last_known_addr { host: "127.16.10.65" port: 41725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69ebcf1734b949a19671e604e9a54cec" member_type: VOTER last_known_addr { host: "127.16.10.66" port: 39107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d15e9450254455f8e3a1d2b194661a2" member_type: VOTER last_known_addr { host: "127.16.10.67" port: 45843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce6c1f2801e84e869ab18938724e5aad" member_type: NON_VOTER last_known_addr { host: "127.16.10.68" port: 43291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 08:13:03.348600 18423 ts_tablet_manager.cc:902] T fd9674d047e34552a9142e4df2147730 P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 69ebcf1734b949a19671e604e9a54cec (127.16.10.66:39107)
F20240503 08:13:03.349082 18423 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (init.queue_time_us, init.queue_time_us) (init.run_cpu_time_us, init.run_cpu_time_us) (init.run_wall_time_us, init.run_wall_time_us) (leader-initialization.queue_time_us, leader-initialization.queue_time_us) (leader-initialization.run_cpu_time_us, leader-initialization.run_cpu_time_us) (leader-initialization.run_wall_time_us, leader-initialization.run_wall_time_us) (log-alloc.queue_time_us, log-alloc.queue_time_us) (log-alloc.run_cpu_time_us, log-alloc.run_cpu_time_us) (log-alloc.run_wall_time_us, log-alloc.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-06c8a838b19a469ea44e7050f78bf375.queue_time_us, tablet-download-pool-06c8a838b19a469ea44e7050f78bf375.queue_time_us) (tablet-download-pool-06c8a838b19a469ea44e7050f78bf375.run_cpu_time_us, tablet-download-pool-06c8a838b19a469ea44e7050f78bf375.run_cpu_time_us) (tablet-download-pool-06c8a838b19a469ea44e7050f78bf375.run_wall_time_us, tablet-download-pool-06c8a838b19a469ea44e7050f78bf375.run_wall_time_us) (tablet-download-pool-2afd3767b7ef41368dfd9f684ad4ce46.queue_time_us, tablet-download-pool-2afd3767b7ef41368dfd9f684ad4ce46.queue_time_us) (tablet-download-pool-2afd3767b7ef41368dfd9f684ad4ce46.run_cpu_time_us, tablet-download-pool-2afd3767b7ef41368dfd9f684ad4ce46.run_cpu_time_us) (tablet-download-pool-2afd3767b7ef41368dfd9f684ad4ce46.run_wall_time_us, tablet-download-pool-2afd3767b7ef41368dfd9f684ad4ce46.run_wall_time_us) (tablet-download-pool-39f868a4bdfb403fa462b79cc5507546.queue_time_us, tablet-download-pool-39f868a4bdfb403fa462b79cc5507546.queue_time_us) (tablet-download-pool-39f868a4bdfb403fa462b79cc5507546.run_cpu_time_us, tablet-download-pool-39f868a4bdfb403fa462b79cc5507546.run_cpu_time_us) (tablet-download-pool-39f868a4bdfb403fa462b79cc5507546.run_wall_time_us, tablet-download-pool-39f868a4bdfb403fa462b79cc5507546.run_wall_time_us) (tablet-download-pool-5167aa62b10d4ad0a97d5388247ee1be.queue_time_us, tablet-download-pool-5167aa62b10d4ad0a97d5388247ee1be.queue_time_us) (tablet-download-pool-5167aa62b10d4ad0a97d5388247ee1be.run_cpu_time_us, tablet-download-pool-5167aa62b10d4ad0a97d5388247ee1be.run_cpu_time_us) (tablet-download-pool-5167aa62b10d4ad0a97d5388247ee1be.run_wall_time_us, tablet-download-pool-5167aa62b10d4ad0a97d5388247ee1be.run_wall_time_us) (tablet-download-pool-519eb7f46c59460ba3b4a5613ff54894.queue_time_us, tablet-download-pool-519eb7f46c59460ba3b4a5613ff54894.queue_time_us) (tablet-download-pool-519eb7f46c59460ba3b4a5613ff54894.run_cpu_time_us, tablet-download-pool-519eb7f46c59460ba3b4a5613ff54894.run_cpu_time_us) (tablet-download-pool-519eb7f46c59460ba3b4a5613ff54894.run_wall_time_us, tablet-download-pool-519eb7f46c59460ba3b4a5613ff54894.run_wall_time_us) (tablet-download-pool-5f95209235434aa0aa22bb6fff89bbb5.queue_time_us, tablet-download-pool-5f95209235434aa0aa22bb6fff89bbb5.queue_time_us) (tablet-download-pool-5f95209235434aa0aa22bb6fff89bbb5.run_cpu_time_us, tablet-download-pool-5f95209235434aa0aa22bb6fff89bbb5.run_cpu_time_us) (tablet-download-pool-5f95209235434aa0aa22bb6fff89bbb5.run_wall_time_us, tablet-download-pool-5f95209235434aa0aa22bb6fff89bbb5.run_wall_time_us) (tablet-download-pool-675688b228f147f8a88e69f43b91ef0c.queue_time_us, tablet-download-pool-675688b228f147f8a88e69f43b91ef0c.queue_time_us) (tablet-download-pool-675688b228f147f8a88e69f43b91ef0c.run_cpu_time_us, tablet-download-pool-675688b228f147f8a88e69f43b91ef0c.run_cpu_time_us) (tablet-download-pool-675688b228f147f8a88e69f43b91ef0c.run_wall_time_us, tablet-download-pool-675688b228f147f8a88e69f43b91ef0c.run_wall_time_us) (tablet-download-pool-70e5b64ee81948b0a2ed2bbb648730bf.queue_time_us, tablet-download-pool-70e5b64ee81948b0a2ed2bbb648730bf.queue_time_us) (tablet-download-pool-70e5b64ee81948b0a2ed2bbb648730bf.run_cpu_time_us, tablet-download-pool-70e5b64ee81948b0a2ed2bbb648730bf.run_cpu_time_us) (tablet-download-pool-70e5b64ee81948b0a2ed2bbb648730bf.run_wall_time_us, tablet-download-pool-70e5b64ee81948b0a2ed2bbb648730bf.run_wall_time_us) (tablet-download-pool-bbcdd1b33ca34becb52d034d7b9f3dcd.queue_time_us, tablet-download-pool-bbcdd1b33ca34becb52d034d7b9f3dcd.queue_time_us) (tablet-download-pool-bbcdd1b33ca34becb52d034d7b9f3dcd.run_cpu_time_us, tablet-download-pool-bbcdd1b33ca34becb52d034d7b9f3dcd.run_cpu_time_us) (tablet-download-pool-bbcdd1b33ca34becb52d034d7b9f3dcd.run_wall_time_us, tablet-download-pool-bbcdd1b33ca34becb52d034d7b9f3dcd.run_wall_time_us) (tablet-download-pool-db0fbf6819374978ab404bbfde4b9d42.queue_time_us, tablet-download-pool-db0fbf6819374978ab404bbfde4b9d42.queue_time_us) (tablet-download-pool-db0fbf6819374978ab404bbfde4b9d42.run_cpu_time_us, tablet-download-pool-db0fbf6819374978ab404bbfde4b9d42.run_cpu_time_us) (tablet-download-pool-db0fbf6819374978ab404bbfde4b9d42.run_wall_time_us, tablet-download-pool-db0fbf6819374978ab404bbfde4b9d42.run_wall_time_us) (tablet-download-pool-e346620585b34fafac5e29522169927a.queue_time_us, tablet-download-pool-e346620585b34fafac5e29522169927a.queue_time_us) (tablet-download-pool-e346620585b34fafac5e29522169927a.run_cpu_time_us, tablet-download-pool-e346620585b34fafac5e29522169927a.run_cpu_time_us) (tablet-download-pool-e346620585b34fafac5e29522169927a.run_wall_time_us, tablet-download-pool-e346620585b34fafac5e29522169927a.run_wall_time_us) (tablet-download-pool-ecc9aa5d797f429d835a9c5e8372fd4e.queue_time_us, tablet-download-pool-ecc9aa5d797f429d835a9c5e8372fd4e.queue_time_us) (tablet-download-pool-ecc9aa5d797f429d835a9c5e8372fd4e.run_cpu_time_us, tablet-download-pool-ecc9aa5d797f429d835a9c5e8372fd4e.run_cpu_time_us) (tablet-download-pool-ecc9aa5d797f429d835a9c5e8372fd4e.run_wall_time_us, tablet-download-pool-ecc9aa5d797f429d835a9c5e8372fd4e.run_wall_time_us) (tablet-download-pool-fd9674d047e34552a9142e4df2147730.queue_time_us, tablet-download-pool-fd9674d047e34552a9142e4df2147730.queue_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us) (wal-append.queue_time_us, wal-append.queue_time_us) (wal-append.run_cpu_time_us, wal-append.run_cpu_time_us) (wal-append.run_wall_time_us, wal-append.run_wall_time_us)
*** Check failure stack trace: ***
*** Aborted at 1714723983 (unix time) try "date -d @1714723983" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800004029) received by PID 16425 (TID 0x7fc4c8054700) from PID 16425; stack trace: ***
@ 0x7fc5716c8980 (unknown) at ??:0
@ 0x7fc566a15fb7 gsignal at ??:0
@ 0x7fc566a17921 abort at ??:0
@ 0x7fc5694cadcd google::LogMessage::Fail() at ??:0
@ 0x7fc5694ceb93 google::LogMessage::SendToLog() at ??:0
@ 0x7fc5694ca7cc google::LogMessage::Flush() at ??:0
@ 0x7fc5694cbf59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc56ab47742 kudu::TraceMetrics::InternName() at ??:0
@ 0x7fc56ab13f8b kudu::ThreadPool::ThreadPool() at ??:0
@ 0x7fc56ab0dcd6 kudu::ThreadPoolBuilder::Build() at ??:0
I20240503 08:13:03.391705 18429 ts_tablet_manager.cc:902] T 56d3f2aacab848e2a887d16316b77932 P ce6c1f2801e84e869ab18938724e5aad: Initiating tablet copy from peer 06335016e7f84df18efcdfacbab289b2 (127.16.10.65:41725)
@ 0x7fc579fda8de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
@ 0x7fc579ff2daf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7fc57a11d480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7fc57a155a8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7fc57a138981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
@ 0x7fc57a13870e std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fc57efda98d std::function<>::operator()() at ??:0
@ 0x7fc56ab17b75 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc56ab1b19c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fc56ab1b019 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fc57efda98d std::function<>::operator()() at ??:0
@ 0x7fc56aaf601e kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc5716bd6db start_thread at ??:0
@ 0x7fc566af871f clone at ??:0