[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240502 01:54:31.580495 24320 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.192.62:33759
I20240502 01:54:31.582041 24320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:54:31.583309 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:54:31.593971 24326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:31.594236 24328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:31.594559 24325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:54:31.596103 24320 server_base.cc:1034] running on GCE node
I20240502 01:54:31.596920 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:54:31.597083 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:54:31.597165 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614871597145 us; error 0 us; skew 500 ppm
I20240502 01:54:31.597479 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:54:31.604188 24320 webserver.cc:460] Webserver started at http://127.23.192.62:40311/ using document root <none> and password file <none>
I20240502 01:54:31.604907 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:54:31.605007 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:54:31.605351 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:54:31.608583 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/master-0-root/instance:
uuid: "ced925c84a4b45629436ad60e5585e6e"
format_stamp: "Formatted at 2024-05-02 01:54:31 on dist-test-slave-kdrn"
I20240502 01:54:31.613970 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20240502 01:54:31.616957 24333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:31.618225 24320 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:54:31.618396 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/master-0-root
uuid: "ced925c84a4b45629436ad60e5585e6e"
format_stamp: "Formatted at 2024-05-02 01:54:31 on dist-test-slave-kdrn"
I20240502 01:54:31.618563 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:54:31.633435 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:54:31.634152 24320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:54:31.634413 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:54:31.650373 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.62:33759
I20240502 01:54:31.650434 24384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.62:33759 every 8 connection(s)
I20240502 01:54:31.654556 24385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:31.666976 24385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e: Bootstrap starting.
I20240502 01:54:31.670293 24385 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:31.671425 24385 log.cc:824] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e: Log is configured to *not* fsync() on all Append() calls
I20240502 01:54:31.673723 24385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e: No bootstrap required, opened a new log
I20240502 01:54:31.680492 24385 raft_consensus.cc:348] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced925c84a4b45629436ad60e5585e6e" member_type: VOTER }
I20240502 01:54:31.680757 24385 raft_consensus.cc:374] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:31.680859 24385 raft_consensus.cc:729] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ced925c84a4b45629436ad60e5585e6e, State: Initialized, Role: FOLLOWER
I20240502 01:54:31.681576 24385 consensus_queue.cc:260] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced925c84a4b45629436ad60e5585e6e" member_type: VOTER }
I20240502 01:54:31.681783 24385 raft_consensus.cc:388] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:54:31.681905 24385 raft_consensus.cc:482] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:54:31.682056 24385 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:31.683970 24385 raft_consensus.cc:504] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced925c84a4b45629436ad60e5585e6e" member_type: VOTER }
I20240502 01:54:31.684440 24385 leader_election.cc:302] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ced925c84a4b45629436ad60e5585e6e; no voters:
I20240502 01:54:31.684981 24385 leader_election.cc:288] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:54:31.685086 24388 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:31.685690 24388 raft_consensus.cc:686] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [term 1 LEADER]: Becoming Leader. State: Replica: ced925c84a4b45629436ad60e5585e6e, State: Running, Role: LEADER
I20240502 01:54:31.686254 24388 consensus_queue.cc:237] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced925c84a4b45629436ad60e5585e6e" member_type: VOTER }
I20240502 01:54:31.686800 24385 sys_catalog.cc:564] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:54:31.689188 24390 sys_catalog.cc:455] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ced925c84a4b45629436ad60e5585e6e. Latest consensus state: current_term: 1 leader_uuid: "ced925c84a4b45629436ad60e5585e6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced925c84a4b45629436ad60e5585e6e" member_type: VOTER } }
I20240502 01:54:31.689217 24389 sys_catalog.cc:455] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ced925c84a4b45629436ad60e5585e6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced925c84a4b45629436ad60e5585e6e" member_type: VOTER } }
I20240502 01:54:31.689525 24389 sys_catalog.cc:458] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [sys.catalog]: This master's current role is: LEADER
I20240502 01:54:31.689589 24390 sys_catalog.cc:458] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [sys.catalog]: This master's current role is: LEADER
I20240502 01:54:31.691766 24396 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:54:31.695991 24396 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:54:31.696628 24320 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240502 01:54:31.703773 24396 catalog_manager.cc:1347] Generated new cluster ID: 016b2e73d6ec4f7f905d5fe6664dce1e
I20240502 01:54:31.703887 24396 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:54:31.727070 24396 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:54:31.728190 24396 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:54:31.739127 24396 catalog_manager.cc:5857] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e: Generated new TSK 0
I20240502 01:54:31.739818 24396 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:54:31.761931 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:54:31.766418 24409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:31.766551 24408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:31.767733 24411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:54:31.768158 24320 server_base.cc:1034] running on GCE node
I20240502 01:54:31.768425 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:54:31.768509 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:54:31.768575 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614871768549 us; error 0 us; skew 500 ppm
I20240502 01:54:31.768751 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:54:31.770094 24320 webserver.cc:460] Webserver started at http://127.23.192.1:43669/ using document root <none> and password file <none>
I20240502 01:54:31.770339 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:54:31.770427 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:54:31.770582 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:54:31.771298 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-0-root/instance:
uuid: "479033503eb94a9885866c04b5816950"
format_stamp: "Formatted at 2024-05-02 01:54:31 on dist-test-slave-kdrn"
I20240502 01:54:31.773979 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240502 01:54:31.775784 24416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:31.776197 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 01:54:31.776325 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-0-root
uuid: "479033503eb94a9885866c04b5816950"
format_stamp: "Formatted at 2024-05-02 01:54:31 on dist-test-slave-kdrn"
I20240502 01:54:31.776443 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:54:31.792797 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:54:31.793380 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:54:31.794205 24320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:54:31.795539 24320 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:54:31.795660 24320 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:31.795778 24320 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:54:31.795897 24320 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20240502 01:54:31.814647 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.1:37437
I20240502 01:54:31.814741 24479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.1:37437 every 8 connection(s)
I20240502 01:54:31.816717 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:54:31.831197 24482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:31.832790 24485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:54:31.839053 24320 server_base.cc:1034] running on GCE node
W20240502 01:54:31.840036 24488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:54:31.840495 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:54:31.840592 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:54:31.840683 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614871840639 us; error 0 us; skew 500 ppm
I20240502 01:54:31.840867 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:54:31.843128 24320 webserver.cc:460] Webserver started at http://127.23.192.2:39711/ using document root <none> and password file <none>
I20240502 01:54:31.843453 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:54:31.843619 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:54:31.843802 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:54:31.844641 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-1-root/instance:
uuid: "c3632444491e435d90d8f4b6301654cb"
format_stamp: "Formatted at 2024-05-02 01:54:31 on dist-test-slave-kdrn"
I20240502 01:54:31.846860 24480 heartbeater.cc:347] Connected to a master server at 127.23.192.62:33759
I20240502 01:54:31.847209 24480 heartbeater.cc:464] Registering TS with master...
I20240502 01:54:31.847966 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 01:54:31.848102 24480 heartbeater.cc:511] Master 127.23.192.62:33759 requested a full tablet report, sending...
I20240502 01:54:31.850237 24492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:31.850715 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240502 01:54:31.850693 24350 ts_manager.cc:194] Registered new tserver with Master: 479033503eb94a9885866c04b5816950 (127.23.192.1:37437)
I20240502 01:54:31.850914 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-1-root
uuid: "c3632444491e435d90d8f4b6301654cb"
format_stamp: "Formatted at 2024-05-02 01:54:31 on dist-test-slave-kdrn"
I20240502 01:54:31.851055 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:54:31.853367 24350 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33364
I20240502 01:54:31.887822 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:54:31.888437 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:54:31.888985 24320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:54:31.889816 24320 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:54:31.889894 24320 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:31.890002 24320 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:54:31.890058 24320 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:31.908265 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.2:40977
I20240502 01:54:31.908368 24554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.2:40977 every 8 connection(s)
I20240502 01:54:31.909976 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:54:31.913175 24558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:54:31.918478 24555 heartbeater.cc:347] Connected to a master server at 127.23.192.62:33759
I20240502 01:54:31.918637 24555 heartbeater.cc:464] Registering TS with master...
I20240502 01:54:31.919265 24555 heartbeater.cc:511] Master 127.23.192.62:33759 requested a full tablet report, sending...
W20240502 01:54:31.920212 24559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:54:31.920293 24350 ts_manager.cc:194] Registered new tserver with Master: c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977)
I20240502 01:54:31.921063 24350 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33378
I20240502 01:54:31.921885 24320 server_base.cc:1034] running on GCE node
W20240502 01:54:31.922628 24561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:54:31.923049 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:54:31.923161 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:54:31.923224 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614871923203 us; error 0 us; skew 500 ppm
I20240502 01:54:31.923409 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:54:31.924738 24320 webserver.cc:460] Webserver started at http://127.23.192.3:43453/ using document root <none> and password file <none>
I20240502 01:54:31.924973 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:54:31.925060 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:54:31.925199 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:54:31.925846 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-2-root/instance:
uuid: "733acd5a64dd410f87531ab9bb22e443"
format_stamp: "Formatted at 2024-05-02 01:54:31 on dist-test-slave-kdrn"
I20240502 01:54:31.928563 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240502 01:54:31.930269 24566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:31.930626 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20240502 01:54:31.930747 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-2-root
uuid: "733acd5a64dd410f87531ab9bb22e443"
format_stamp: "Formatted at 2024-05-02 01:54:31 on dist-test-slave-kdrn"
I20240502 01:54:31.930915 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714614871514479-24320-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:54:31.951203 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:54:31.951812 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:54:31.952469 24320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:54:31.953523 24320 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:54:31.953625 24320 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:31.953729 24320 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:54:31.953814 24320 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:31.972424 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.3:39489
I20240502 01:54:31.972457 24629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.3:39489 every 8 connection(s)
I20240502 01:54:31.980625 24630 heartbeater.cc:347] Connected to a master server at 127.23.192.62:33759
I20240502 01:54:31.980762 24630 heartbeater.cc:464] Registering TS with master...
I20240502 01:54:31.981216 24630 heartbeater.cc:511] Master 127.23.192.62:33759 requested a full tablet report, sending...
I20240502 01:54:31.982096 24350 ts_manager.cc:194] Registered new tserver with Master: 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:31.982223 24320 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.008578446s
I20240502 01:54:31.982908 24350 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33390
I20240502 01:54:31.984341 24320 test_util.cc:268] Using random seed: -497088329
I20240502 01:54:32.009469 24350 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33406:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240502 01:54:32.012279 24350 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240502 01:54:32.047030 24594 tablet_service.cc:1467] Processing CreateTablet for tablet 481b1a040e2f495eaac60225b0897684 (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240502 01:54:32.047982 24594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 481b1a040e2f495eaac60225b0897684. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.051198 24593 tablet_service.cc:1467] Processing CreateTablet for tablet 8bbaf2cb89774b03ac4233ef5575f7fe (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240502 01:54:32.051360 24445 tablet_service.cc:1467] Processing CreateTablet for tablet 481b1a040e2f495eaac60225b0897684 (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240502 01:54:32.051796 24593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bbaf2cb89774b03ac4233ef5575f7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.051797 24445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 481b1a040e2f495eaac60225b0897684. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.057252 24591 tablet_service.cc:1467] Processing CreateTablet for tablet e22953c0a720422a9b5336ac903786e6 (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240502 01:54:32.056567 24444 tablet_service.cc:1467] Processing CreateTablet for tablet 8bbaf2cb89774b03ac4233ef5575f7fe (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240502 01:54:32.058032 24440 tablet_service.cc:1467] Processing CreateTablet for tablet 4ae222544203452aa1402c768b9c0cea (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240502 01:54:32.059876 24591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e22953c0a720422a9b5336ac903786e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.058204 24441 tablet_service.cc:1467] Processing CreateTablet for tablet 64f8d56b12f8455b892a3c1d88e20c3e (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240502 01:54:32.066119 24444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bbaf2cb89774b03ac4233ef5575f7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.065701 24442 tablet_service.cc:1467] Processing CreateTablet for tablet e22953c0a720422a9b5336ac903786e6 (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240502 01:54:32.067566 24439 tablet_service.cc:1467] Processing CreateTablet for tablet 7524737028cb46daa68e14e1240e7a07 (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240502 01:54:32.066747 24586 tablet_service.cc:1467] Processing CreateTablet for tablet 37b9e21a819f4ad598db306cc367187a (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240502 01:54:32.072069 24441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64f8d56b12f8455b892a3c1d88e20c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.068315 24437 tablet_service.cc:1467] Processing CreateTablet for tablet 37b9e21a819f4ad598db306cc367187a (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240502 01:54:32.073161 24440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ae222544203452aa1402c768b9c0cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.069511 24589 tablet_service.cc:1467] Processing CreateTablet for tablet 4ae222544203452aa1402c768b9c0cea (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240502 01:54:32.070510 24590 tablet_service.cc:1467] Processing CreateTablet for tablet 64f8d56b12f8455b892a3c1d88e20c3e (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240502 01:54:32.070679 24443 tablet_service.cc:1467] Processing CreateTablet for tablet ac3d1baa68bb4ec98e5202968129c974 (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240502 01:54:32.070735 24438 tablet_service.cc:1467] Processing CreateTablet for tablet 83b5855189fd473d8353d300fc707d4d (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240502 01:54:32.077380 24442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e22953c0a720422a9b5336ac903786e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.070868 24520 tablet_service.cc:1467] Processing CreateTablet for tablet 481b1a040e2f495eaac60225b0897684 (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240502 01:54:32.078181 24439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7524737028cb46daa68e14e1240e7a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.078399 24437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37b9e21a819f4ad598db306cc367187a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.078694 24443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3d1baa68bb4ec98e5202968129c974. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.073232 24588 tablet_service.cc:1467] Processing CreateTablet for tablet 7524737028cb46daa68e14e1240e7a07 (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240502 01:54:32.081643 24586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37b9e21a819f4ad598db306cc367187a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.071097 24587 tablet_service.cc:1467] Processing CreateTablet for tablet 83b5855189fd473d8353d300fc707d4d (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240502 01:54:32.072005 24592 tablet_service.cc:1467] Processing CreateTablet for tablet ac3d1baa68bb4ec98e5202968129c974 (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240502 01:54:32.073908 24515 tablet_service.cc:1467] Processing CreateTablet for tablet 4ae222544203452aa1402c768b9c0cea (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240502 01:54:32.073877 24517 tablet_service.cc:1467] Processing CreateTablet for tablet e22953c0a720422a9b5336ac903786e6 (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240502 01:54:32.086280 24590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64f8d56b12f8455b892a3c1d88e20c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.075923 24519 tablet_service.cc:1467] Processing CreateTablet for tablet 8bbaf2cb89774b03ac4233ef5575f7fe (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240502 01:54:32.086560 24438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83b5855189fd473d8353d300fc707d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.087354 24589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ae222544203452aa1402c768b9c0cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.087523 24645 tablet_bootstrap.cc:492] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443: Bootstrap starting.
I20240502 01:54:32.089653 24646 tablet_bootstrap.cc:492] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950: Bootstrap starting.
I20240502 01:54:32.090495 24588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7524737028cb46daa68e14e1240e7a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.087095 24518 tablet_service.cc:1467] Processing CreateTablet for tablet ac3d1baa68bb4ec98e5202968129c974 (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240502 01:54:32.091121 24520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 481b1a040e2f495eaac60225b0897684. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.090996 24587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83b5855189fd473d8353d300fc707d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.093194 24592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3d1baa68bb4ec98e5202968129c974. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.095134 24515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ae222544203452aa1402c768b9c0cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.090291 24516 tablet_service.cc:1467] Processing CreateTablet for tablet 64f8d56b12f8455b892a3c1d88e20c3e (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240502 01:54:32.090327 24514 tablet_service.cc:1467] Processing CreateTablet for tablet 7524737028cb46daa68e14e1240e7a07 (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240502 01:54:32.094000 24513 tablet_service.cc:1467] Processing CreateTablet for tablet 83b5855189fd473d8353d300fc707d4d (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240502 01:54:32.099665 24518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3d1baa68bb4ec98e5202968129c974. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.099020 24512 tablet_service.cc:1467] Processing CreateTablet for tablet 37b9e21a819f4ad598db306cc367187a (DEFAULT_TABLE table=test-workload [id=2284d5a84847474abd695fba6309d41e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240502 01:54:32.102154 24519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bbaf2cb89774b03ac4233ef5575f7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.102377 24514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7524737028cb46daa68e14e1240e7a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.103401 24513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83b5855189fd473d8353d300fc707d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.107396 24516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64f8d56b12f8455b892a3c1d88e20c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.114707 24517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e22953c0a720422a9b5336ac903786e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.116144 24512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37b9e21a819f4ad598db306cc367187a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:32.134446 24645 tablet_bootstrap.cc:654] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.152115 24646 tablet_bootstrap.cc:654] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.180642 24645 tablet_bootstrap.cc:492] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443: No bootstrap required, opened a new log
I20240502 01:54:32.180851 24645 ts_tablet_manager.cc:1367] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443: Time spent bootstrapping tablet: real 0.097s user 0.012s sys 0.015s
I20240502 01:54:32.185137 24648 tablet_bootstrap.cc:492] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb: Bootstrap starting.
I20240502 01:54:32.187767 24646 tablet_bootstrap.cc:492] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950: No bootstrap required, opened a new log
I20240502 01:54:32.187897 24646 ts_tablet_manager.cc:1367] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950: Time spent bootstrapping tablet: real 0.098s user 0.000s sys 0.008s
I20240502 01:54:32.188424 24648 tablet_bootstrap.cc:654] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.188612 24646 raft_consensus.cc:348] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:32.188840 24646 raft_consensus.cc:374] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.188946 24646 raft_consensus.cc:729] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.189213 24646 consensus_queue.cc:260] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:32.190450 24480 heartbeater.cc:503] Master 127.23.192.62:33759 was elected leader, sending a full tablet report...
I20240502 01:54:32.190158 24646 ts_tablet_manager.cc:1398] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:54:32.190759 24648 tablet_bootstrap.cc:492] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb: No bootstrap required, opened a new log
I20240502 01:54:32.190922 24648 ts_tablet_manager.cc:1367] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20240502 01:54:32.191045 24646 tablet_bootstrap.cc:492] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950: Bootstrap starting.
I20240502 01:54:32.191754 24648 raft_consensus.cc:348] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.191977 24648 raft_consensus.cc:374] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.192103 24648 raft_consensus.cc:729] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.192384 24648 consensus_queue.cc:260] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.192682 24646 tablet_bootstrap.cc:654] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.193266 24648 ts_tablet_manager.cc:1398] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:54:32.193554 24648 tablet_bootstrap.cc:492] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb: Bootstrap starting.
I20240502 01:54:32.193639 24645 raft_consensus.cc:348] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.193876 24645 raft_consensus.cc:374] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.193982 24645 raft_consensus.cc:729] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.194226 24645 consensus_queue.cc:260] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.194983 24555 heartbeater.cc:503] Master 127.23.192.62:33759 was elected leader, sending a full tablet report...
I20240502 01:54:32.195297 24648 tablet_bootstrap.cc:654] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.202530 24630 heartbeater.cc:503] Master 127.23.192.62:33759 was elected leader, sending a full tablet report...
I20240502 01:54:32.203229 24645 ts_tablet_manager.cc:1398] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443: Time spent starting tablet: real 0.022s user 0.006s sys 0.003s
I20240502 01:54:32.203455 24648 tablet_bootstrap.cc:492] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb: No bootstrap required, opened a new log
I20240502 01:54:32.203548 24645 tablet_bootstrap.cc:492] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443: Bootstrap starting.
I20240502 01:54:32.203627 24648 ts_tablet_manager.cc:1367] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20240502 01:54:32.204419 24648 raft_consensus.cc:348] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:32.204655 24648 raft_consensus.cc:374] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.204741 24648 raft_consensus.cc:729] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.205178 24645 tablet_bootstrap.cc:654] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.205085 24648 consensus_queue.cc:260] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:32.205601 24648 ts_tablet_manager.cc:1398] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:54:32.205906 24648 tablet_bootstrap.cc:492] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb: Bootstrap starting.
I20240502 01:54:32.207545 24648 tablet_bootstrap.cc:654] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.209131 24646 tablet_bootstrap.cc:492] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950: No bootstrap required, opened a new log
I20240502 01:54:32.209291 24646 ts_tablet_manager.cc:1367] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.005s
I20240502 01:54:32.210143 24646 raft_consensus.cc:348] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.210383 24646 raft_consensus.cc:374] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.210464 24646 raft_consensus.cc:729] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.210639 24648 tablet_bootstrap.cc:492] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb: No bootstrap required, opened a new log
I20240502 01:54:32.210776 24648 ts_tablet_manager.cc:1367] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20240502 01:54:32.210709 24646 consensus_queue.cc:260] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.211315 24646 ts_tablet_manager.cc:1398] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:54:32.211692 24646 tablet_bootstrap.cc:492] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950: Bootstrap starting.
I20240502 01:54:32.211664 24648 raft_consensus.cc:348] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.211907 24648 raft_consensus.cc:374] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.212158 24648 raft_consensus.cc:729] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.212869 24648 consensus_queue.cc:260] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.214313 24646 tablet_bootstrap.cc:654] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.214922 24648 ts_tablet_manager.cc:1398] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240502 01:54:32.215896 24648 tablet_bootstrap.cc:492] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb: Bootstrap starting.
I20240502 01:54:32.216805 24645 tablet_bootstrap.cc:492] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443: No bootstrap required, opened a new log
I20240502 01:54:32.216992 24645 ts_tablet_manager.cc:1367] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.008s
I20240502 01:54:32.217658 24648 tablet_bootstrap.cc:654] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.217859 24645 raft_consensus.cc:348] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:32.218113 24645 raft_consensus.cc:374] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.218210 24645 raft_consensus.cc:729] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.218547 24645 consensus_queue.cc:260] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:32.219072 24645 ts_tablet_manager.cc:1398] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20240502 01:54:32.219388 24645 tablet_bootstrap.cc:492] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443: Bootstrap starting.
I20240502 01:54:32.220944 24645 tablet_bootstrap.cc:654] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.223958 24645 tablet_bootstrap.cc:492] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443: No bootstrap required, opened a new log
W20240502 01:54:32.224052 24631 tablet.cc:2369] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:54:32.224119 24645 ts_tablet_manager.cc:1367] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 01:54:32.224948 24645 raft_consensus.cc:348] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.225157 24645 raft_consensus.cc:374] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.225279 24645 raft_consensus.cc:729] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.225656 24652 raft_consensus.cc:482] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:32.225822 24652 raft_consensus.cc:504] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:32.227896 24652 leader_election.cc:288] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489), 479033503eb94a9885866c04b5816950 (127.23.192.1:37437)
I20240502 01:54:32.229025 24648 tablet_bootstrap.cc:492] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb: No bootstrap required, opened a new log
I20240502 01:54:32.229040 24646 tablet_bootstrap.cc:492] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950: No bootstrap required, opened a new log
I20240502 01:54:32.229221 24648 ts_tablet_manager.cc:1367] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.006s
I20240502 01:54:32.229444 24646 ts_tablet_manager.cc:1367] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.005s
I20240502 01:54:32.230062 24648 raft_consensus.cc:348] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.230291 24648 raft_consensus.cc:374] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.230387 24648 raft_consensus.cc:729] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.230533 24646 raft_consensus.cc:348] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.230657 24648 consensus_queue.cc:260] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.230787 24646 raft_consensus.cc:374] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.231035 24646 raft_consensus.cc:729] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.231422 24646 consensus_queue.cc:260] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.231993 24646 ts_tablet_manager.cc:1398] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:54:32.232338 24646 tablet_bootstrap.cc:492] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950: Bootstrap starting.
I20240502 01:54:32.233577 24648 ts_tablet_manager.cc:1398] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20240502 01:54:32.233915 24648 tablet_bootstrap.cc:492] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb: Bootstrap starting.
I20240502 01:54:32.234218 24646 tablet_bootstrap.cc:654] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.225535 24645 consensus_queue.cc:260] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.238988 24645 ts_tablet_manager.cc:1398] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20240502 01:54:32.239266 24645 tablet_bootstrap.cc:492] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443: Bootstrap starting.
I20240502 01:54:32.240882 24648 tablet_bootstrap.cc:654] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.244005 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "481b1a040e2f495eaac60225b0897684" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443" is_pre_election: true
I20240502 01:54:32.244825 24605 raft_consensus.cc:2454] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 0.
I20240502 01:54:32.247686 24494 leader_election.cc:302] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 733acd5a64dd410f87531ab9bb22e443, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.248359 24652 raft_consensus.cc:2781] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:32.248687 24652 raft_consensus.cc:482] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:32.249012 24652 raft_consensus.cc:3037] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.250747 24645 tablet_bootstrap.cc:654] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.251120 24646 tablet_bootstrap.cc:492] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950: No bootstrap required, opened a new log
I20240502 01:54:32.253304 24652 raft_consensus.cc:504] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:32.255059 24646 ts_tablet_manager.cc:1367] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.014s
I20240502 01:54:32.255553 24652 leader_election.cc:288] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 election: Requested vote from peers 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489), 479033503eb94a9885866c04b5816950 (127.23.192.1:37437)
I20240502 01:54:32.255864 24646 raft_consensus.cc:348] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.255860 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "481b1a040e2f495eaac60225b0897684" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:32.256160 24646 raft_consensus.cc:374] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.256254 24646 raft_consensus.cc:729] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.256304 24605 raft_consensus.cc:3037] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.254463 24648 tablet_bootstrap.cc:492] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb: No bootstrap required, opened a new log
I20240502 01:54:32.256780 24646 consensus_queue.cc:260] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.257596 24646 ts_tablet_manager.cc:1398] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:54:32.257678 24648 ts_tablet_manager.cc:1367] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.000s
I20240502 01:54:32.261850 24645 tablet_bootstrap.cc:492] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443: No bootstrap required, opened a new log
I20240502 01:54:32.262926 24646 tablet_bootstrap.cc:492] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950: Bootstrap starting.
I20240502 01:54:32.262977 24605 raft_consensus.cc:2454] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 1.
I20240502 01:54:32.263082 24454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "481b1a040e2f495eaac60225b0897684" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:32.263394 24454 raft_consensus.cc:3037] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.263505 24494 leader_election.cc:302] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 733acd5a64dd410f87531ab9bb22e443, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.263814 24652 raft_consensus.cc:2781] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:32.263862 24648 raft_consensus.cc:348] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.264086 24648 raft_consensus.cc:374] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.264191 24648 raft_consensus.cc:729] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.264405 24648 consensus_queue.cc:260] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.264727 24646 tablet_bootstrap.cc:654] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.263029 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "481b1a040e2f495eaac60225b0897684" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950" is_pre_election: true
I20240502 01:54:32.267233 24652 raft_consensus.cc:686] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Becoming Leader. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:32.267586 24652 consensus_queue.cc:237] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:32.269656 24454 raft_consensus.cc:2454] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 1.
I20240502 01:54:32.270033 24648 ts_tablet_manager.cc:1398] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb: Time spent starting tablet: real 0.010s user 0.001s sys 0.004s
I20240502 01:54:32.270337 24648 tablet_bootstrap.cc:492] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb: Bootstrap starting.
I20240502 01:54:32.270444 24645 ts_tablet_manager.cc:1367] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.006s
I20240502 01:54:32.271288 24645 raft_consensus.cc:348] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.271580 24645 raft_consensus.cc:374] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.271724 24645 raft_consensus.cc:729] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.272147 24648 tablet_bootstrap.cc:654] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.272070 24645 consensus_queue.cc:260] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.273715 24645 ts_tablet_manager.cc:1398] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:54:32.274101 24645 tablet_bootstrap.cc:492] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443: Bootstrap starting.
I20240502 01:54:32.277089 24645 tablet_bootstrap.cc:654] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.278143 24349 catalog_manager.cc:5484] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c3632444491e435d90d8f4b6301654cb (127.23.192.2). New cstate: current_term: 1 leader_uuid: "c3632444491e435d90d8f4b6301654cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:32.281265 24654 raft_consensus.cc:482] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:32.281404 24654 raft_consensus.cc:504] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.282416 24654 leader_election.cc:288] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977)
I20240502 01:54:32.289366 24646 tablet_bootstrap.cc:492] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950: No bootstrap required, opened a new log
I20240502 01:54:32.289551 24646 ts_tablet_manager.cc:1367] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950: Time spent bootstrapping tablet: real 0.032s user 0.010s sys 0.010s
I20240502 01:54:32.291378 24646 raft_consensus.cc:348] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.291620 24646 raft_consensus.cc:374] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.293772 24648 tablet_bootstrap.cc:492] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb: No bootstrap required, opened a new log
I20240502 01:54:32.294157 24648 ts_tablet_manager.cc:1367] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.010s
I20240502 01:54:32.294195 24645 tablet_bootstrap.cc:492] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443: No bootstrap required, opened a new log
I20240502 01:54:32.294351 24645 ts_tablet_manager.cc:1367] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20240502 01:54:32.294939 24648 raft_consensus.cc:348] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.295162 24648 raft_consensus.cc:374] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.295269 24648 raft_consensus.cc:729] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.295220 24645 raft_consensus.cc:348] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.295439 24645 raft_consensus.cc:374] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.295558 24645 raft_consensus.cc:729] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.295593 24648 consensus_queue.cc:260] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.295825 24645 consensus_queue.cc:260] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.297680 24648 ts_tablet_manager.cc:1398] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:54:32.298012 24648 tablet_bootstrap.cc:492] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb: Bootstrap starting.
I20240502 01:54:32.298686 24652 raft_consensus.cc:482] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:32.298902 24652 raft_consensus.cc:504] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.299136 24645 ts_tablet_manager.cc:1398] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:54:32.299538 24652 leader_election.cc:288] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.300006 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ae222544203452aa1402c768b9c0cea" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443" is_pre_election: true
I20240502 01:54:32.300063 24454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ae222544203452aa1402c768b9c0cea" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950" is_pre_election: true
I20240502 01:54:32.300279 24454 raft_consensus.cc:2454] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 0.
I20240502 01:54:32.300925 24496 leader_election.cc:302] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
W20240502 01:54:32.301162 24494 leader_election.cc:341] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:54:32.301270 24652 raft_consensus.cc:2781] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:32.301371 24652 raft_consensus.cc:482] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:32.301498 24645 tablet_bootstrap.cc:492] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443: Bootstrap starting.
I20240502 01:54:32.301501 24652 raft_consensus.cc:3037] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.303238 24645 tablet_bootstrap.cc:654] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.304244 24646 raft_consensus.cc:729] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.304483 24652 raft_consensus.cc:504] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.304546 24646 consensus_queue.cc:260] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.306871 24646 ts_tablet_manager.cc:1398] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950: Time spent starting tablet: real 0.016s user 0.001s sys 0.002s
I20240502 01:54:32.306900 24652 leader_election.cc:288] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.307006 24454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ae222544203452aa1402c768b9c0cea" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:32.307992 24646 tablet_bootstrap.cc:492] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950: Bootstrap starting.
I20240502 01:54:32.308001 24454 raft_consensus.cc:3037] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.308621 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ae222544203452aa1402c768b9c0cea" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
W20240502 01:54:32.310547 24494 leader_election.cc:341] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:54:32.311115 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950" is_pre_election: true
I20240502 01:54:32.311511 24455 raft_consensus.cc:2454] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 0.
I20240502 01:54:32.312011 24570 leader_election.cc:302] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, 733acd5a64dd410f87531ab9bb22e443; no voters:
I20240502 01:54:32.312320 24654 raft_consensus.cc:2781] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:32.312592 24654 raft_consensus.cc:482] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:32.312723 24654 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.312965 24648 tablet_bootstrap.cc:654] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.313231 24645 tablet_bootstrap.cc:492] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443: No bootstrap required, opened a new log
I20240502 01:54:32.313428 24645 ts_tablet_manager.cc:1367] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20240502 01:54:32.313730 24646 tablet_bootstrap.cc:654] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.314167 24645 raft_consensus.cc:348] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.316401 24648 tablet_bootstrap.cc:492] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb: No bootstrap required, opened a new log
I20240502 01:54:32.317639 24454 raft_consensus.cc:2454] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 1.
I20240502 01:54:32.319096 24648 ts_tablet_manager.cc:1367] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20240502 01:54:32.319366 24646 tablet_bootstrap.cc:492] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950: No bootstrap required, opened a new log
I20240502 01:54:32.319530 24646 ts_tablet_manager.cc:1367] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.002s
I20240502 01:54:32.319458 24496 leader_election.cc:302] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters: 733acd5a64dd410f87531ab9bb22e443
I20240502 01:54:32.318338 24654 raft_consensus.cc:504] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.316305 24645 raft_consensus.cc:374] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.320057 24645 raft_consensus.cc:729] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.320225 24646 raft_consensus.cc:348] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.320369 24654 leader_election.cc:288] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 1 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977)
I20240502 01:54:32.320565 24652 raft_consensus.cc:2781] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:32.320489 24645 consensus_queue.cc:260] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.320727 24652 raft_consensus.cc:686] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Becoming Leader. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:32.321064 24652 consensus_queue.cc:237] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.321354 24648 raft_consensus.cc:348] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.321564 24648 raft_consensus.cc:374] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.321655 24648 raft_consensus.cc:729] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.320511 24646 raft_consensus.cc:374] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.321903 24646 raft_consensus.cc:729] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.321866 24648 consensus_queue.cc:260] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.322425 24648 ts_tablet_manager.cc:1398] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:54:32.322433 24454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:32.322753 24454 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.322759 24648 tablet_bootstrap.cc:492] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb: Bootstrap starting.
I20240502 01:54:32.324644 24648 tablet_bootstrap.cc:654] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.326220 24646 consensus_queue.cc:260] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.326900 24454 raft_consensus.cc:2454] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 1.
I20240502 01:54:32.327260 24646 ts_tablet_manager.cc:1398] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20240502 01:54:32.327374 24570 leader_election.cc:302] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, 733acd5a64dd410f87531ab9bb22e443; no voters:
I20240502 01:54:32.327593 24646 tablet_bootstrap.cc:492] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950: Bootstrap starting.
I20240502 01:54:32.329177 24646 tablet_bootstrap.cc:654] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.331699 24654 raft_consensus.cc:2781] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:32.331845 24654 raft_consensus.cc:686] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 1 LEADER]: Becoming Leader. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Running, Role: LEADER
I20240502 01:54:32.332098 24654 consensus_queue.cc:237] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.335661 24530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3632444491e435d90d8f4b6301654cb" is_pre_election: true
I20240502 01:54:32.335770 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3632444491e435d90d8f4b6301654cb"
W20240502 01:54:32.336584 24568 leader_election.cc:341] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977): Illegal state: must be running to vote when last-logged opid is not known
W20240502 01:54:32.336921 24568 leader_election.cc:341] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:54:32.338202 24349 catalog_manager.cc:5484] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "733acd5a64dd410f87531ab9bb22e443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: HEALTHY } } }
I20240502 01:54:32.339439 24646 tablet_bootstrap.cc:492] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950: No bootstrap required, opened a new log
I20240502 01:54:32.339581 24646 ts_tablet_manager.cc:1367] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.001s
I20240502 01:54:32.340333 24646 raft_consensus.cc:348] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.340523 24646 raft_consensus.cc:374] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.340631 24646 raft_consensus.cc:729] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.340831 24646 consensus_queue.cc:260] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.342993 24646 ts_tablet_manager.cc:1398] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:54:32.343298 24646 tablet_bootstrap.cc:492] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950: Bootstrap starting.
I20240502 01:54:32.344179 24350 catalog_manager.cc:5484] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c3632444491e435d90d8f4b6301654cb (127.23.192.2). New cstate: current_term: 1 leader_uuid: "c3632444491e435d90d8f4b6301654cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:32.344938 24646 tablet_bootstrap.cc:654] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.349421 24645 ts_tablet_manager.cc:1398] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443: Time spent starting tablet: real 0.036s user 0.001s sys 0.001s
I20240502 01:54:32.350232 24646 tablet_bootstrap.cc:492] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950: No bootstrap required, opened a new log
I20240502 01:54:32.350401 24646 ts_tablet_manager.cc:1367] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20240502 01:54:32.350764 24645 tablet_bootstrap.cc:492] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443: Bootstrap starting.
I20240502 01:54:32.351179 24646 raft_consensus.cc:348] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.351415 24646 raft_consensus.cc:374] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.351505 24646 raft_consensus.cc:729] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.351622 24648 tablet_bootstrap.cc:492] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb: No bootstrap required, opened a new log
I20240502 01:54:32.351768 24648 ts_tablet_manager.cc:1367] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.009s
I20240502 01:54:32.351747 24646 consensus_queue.cc:260] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.352402 24646 ts_tablet_manager.cc:1398] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:54:32.352705 24646 tablet_bootstrap.cc:492] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950: Bootstrap starting.
I20240502 01:54:32.353147 24645 tablet_bootstrap.cc:654] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.354241 24648 raft_consensus.cc:348] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.354499 24648 raft_consensus.cc:374] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.354594 24648 raft_consensus.cc:729] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.354645 24646 tablet_bootstrap.cc:654] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.354815 24648 consensus_queue.cc:260] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.355295 24678 raft_consensus.cc:482] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:32.355463 24678 raft_consensus.cc:504] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.356293 24678 leader_election.cc:288] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977)
I20240502 01:54:32.357019 24454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9e21a819f4ad598db306cc367187a" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950" is_pre_election: true
I20240502 01:54:32.357270 24454 raft_consensus.cc:2454] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 0.
I20240502 01:54:32.357723 24570 leader_election.cc:302] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, 733acd5a64dd410f87531ab9bb22e443; no voters:
I20240502 01:54:32.358048 24678 raft_consensus.cc:2781] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:32.358160 24678 raft_consensus.cc:482] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:32.358248 24678 raft_consensus.cc:3037] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.359014 24648 ts_tablet_manager.cc:1398] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240502 01:54:32.361078 24678 raft_consensus.cc:504] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.361459 24648 tablet_bootstrap.cc:492] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb: Bootstrap starting.
I20240502 01:54:32.362021 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9e21a819f4ad598db306cc367187a" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:32.362218 24455 raft_consensus.cc:3037] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.363224 24648 tablet_bootstrap.cc:654] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.365131 24455 raft_consensus.cc:2454] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 1.
I20240502 01:54:32.357050 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9e21a819f4ad598db306cc367187a" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3632444491e435d90d8f4b6301654cb" is_pre_election: true
I20240502 01:54:32.365687 24529 raft_consensus.cc:2454] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 0.
I20240502 01:54:32.366062 24570 leader_election.cc:302] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, 733acd5a64dd410f87531ab9bb22e443; no voters:
I20240502 01:54:32.366333 24654 raft_consensus.cc:2781] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:32.367178 24648 tablet_bootstrap.cc:492] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb: No bootstrap required, opened a new log
I20240502 01:54:32.367352 24648 ts_tablet_manager.cc:1367] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20240502 01:54:32.367563 24678 leader_election.cc:288] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 1 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977)
I20240502 01:54:32.367815 24651 raft_consensus.cc:482] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:32.367990 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b9e21a819f4ad598db306cc367187a" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:32.368191 24529 raft_consensus.cc:3037] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.368113 24651 raft_consensus.cc:504] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.369143 24651 leader_election.cc:288] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.369258 24652 raft_consensus.cc:482] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:32.369413 24652 raft_consensus.cc:504] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.370081 24652 leader_election.cc:288] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.370455 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950" is_pre_election: true
I20240502 01:54:32.370631 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443" is_pre_election: true
I20240502 01:54:32.370882 24605 raft_consensus.cc:2454] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 0.
W20240502 01:54:32.371032 24496 leader_election.cc:341] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 479033503eb94a9885866c04b5816950 (127.23.192.1:37437): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:54:32.371312 24494 leader_election.cc:302] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 733acd5a64dd410f87531ab9bb22e443, c3632444491e435d90d8f4b6301654cb; no voters: 479033503eb94a9885866c04b5816950
I20240502 01:54:32.371608 24652 raft_consensus.cc:2781] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:32.371717 24652 raft_consensus.cc:482] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:32.371809 24652 raft_consensus.cc:3037] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.372601 24529 raft_consensus.cc:2454] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 1.
I20240502 01:54:32.373742 24648 raft_consensus.cc:348] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.373987 24648 raft_consensus.cc:374] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.374127 24648 raft_consensus.cc:729] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.374320 24652 raft_consensus.cc:504] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.374425 24648 consensus_queue.cc:260] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.374922 24652 leader_election.cc:288] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.375213 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950"
W20240502 01:54:32.375619 24496 leader_election.cc:341] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 479033503eb94a9885866c04b5816950 (127.23.192.1:37437): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:54:32.377442 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:32.377673 24605 raft_consensus.cc:3037] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.380650 24605 raft_consensus.cc:2454] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 1.
I20240502 01:54:32.381013 24494 leader_election.cc:302] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 733acd5a64dd410f87531ab9bb22e443, c3632444491e435d90d8f4b6301654cb; no voters: 479033503eb94a9885866c04b5816950
I20240502 01:54:32.381307 24652 raft_consensus.cc:2781] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:32.381460 24652 raft_consensus.cc:686] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Becoming Leader. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:32.381721 24652 consensus_queue.cc:237] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.381855 24648 ts_tablet_manager.cc:1398] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20240502 01:54:32.382182 24654 raft_consensus.cc:686] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 1 LEADER]: Becoming Leader. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Running, Role: LEADER
I20240502 01:54:32.382498 24654 consensus_queue.cc:237] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.386076 24645 tablet_bootstrap.cc:492] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443: No bootstrap required, opened a new log
I20240502 01:54:32.386289 24645 ts_tablet_manager.cc:1367] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.006s
I20240502 01:54:32.387228 24645 raft_consensus.cc:348] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.387503 24645 raft_consensus.cc:374] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.387892 24645 raft_consensus.cc:729] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.388231 24646 tablet_bootstrap.cc:492] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950: No bootstrap required, opened a new log
I20240502 01:54:32.388370 24646 ts_tablet_manager.cc:1367] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.017s
I20240502 01:54:32.388188 24645 consensus_queue.cc:260] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.388868 24645 ts_tablet_manager.cc:1398] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:54:32.389206 24645 tablet_bootstrap.cc:492] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443: Bootstrap starting.
I20240502 01:54:32.389083 24646 raft_consensus.cc:348] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.390942 24646 raft_consensus.cc:374] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.391243 24646 raft_consensus.cc:729] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.391296 24645 tablet_bootstrap.cc:654] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.391782 24646 consensus_queue.cc:260] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.392777 24646 ts_tablet_manager.cc:1398] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 01:54:32.398609 24348 catalog_manager.cc:5484] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c3632444491e435d90d8f4b6301654cb (127.23.192.2). New cstate: current_term: 1 leader_uuid: "c3632444491e435d90d8f4b6301654cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:32.400409 24645 tablet_bootstrap.cc:492] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443: No bootstrap required, opened a new log
I20240502 01:54:32.402864 24645 ts_tablet_manager.cc:1367] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.002s
I20240502 01:54:32.403040 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64f8d56b12f8455b892a3c1d88e20c3e" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3632444491e435d90d8f4b6301654cb" is_pre_election: true
I20240502 01:54:32.403254 24529 raft_consensus.cc:2454] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 0.
I20240502 01:54:32.403720 24349 catalog_manager.cc:5484] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "733acd5a64dd410f87531ab9bb22e443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: HEALTHY } } }
I20240502 01:54:32.403935 24418 leader_election.cc:302] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.404184 24651 raft_consensus.cc:2781] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:32.404359 24651 raft_consensus.cc:482] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:32.404462 24651 raft_consensus.cc:3037] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.406639 24651 raft_consensus.cc:504] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.407166 24651 leader_election.cc:288] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 election: Requested vote from peers c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.407580 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64f8d56b12f8455b892a3c1d88e20c3e" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:32.407785 24529 raft_consensus.cc:3037] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.410604 24651 raft_consensus.cc:482] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:32.410750 24651 raft_consensus.cc:504] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.411782 24645 raft_consensus.cc:348] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.412842 24651 leader_election.cc:288] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.412919 24530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3d1baa68bb4ec98e5202968129c974" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3632444491e435d90d8f4b6301654cb" is_pre_election: true
I20240502 01:54:32.413018 24529 raft_consensus.cc:2454] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 1.
I20240502 01:54:32.413121 24530 raft_consensus.cc:2454] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 0.
I20240502 01:54:32.413444 24605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64f8d56b12f8455b892a3c1d88e20c3e" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443" is_pre_election: true
I20240502 01:54:32.413496 24418 leader_election.cc:302] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.413678 24645 raft_consensus.cc:374] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.413769 24645 raft_consensus.cc:729] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.413798 24418 leader_election.cc:302] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.413717 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64f8d56b12f8455b892a3c1d88e20c3e" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:32.413997 24645 consensus_queue.cc:260] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.414160 24651 raft_consensus.cc:2781] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:32.414211 24605 raft_consensus.cc:2454] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 0.
I20240502 01:54:32.414207 24603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3d1baa68bb4ec98e5202968129c974" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443" is_pre_election: true
I20240502 01:54:32.414705 24645 ts_tablet_manager.cc:1398] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20240502 01:54:32.415541 24645 tablet_bootstrap.cc:492] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443: Bootstrap starting.
I20240502 01:54:32.417054 24645 tablet_bootstrap.cc:654] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:32.419595 24645 tablet_bootstrap.cc:492] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443: No bootstrap required, opened a new log
I20240502 01:54:32.419734 24645 ts_tablet_manager.cc:1367] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.002s
I20240502 01:54:32.420418 24645 raft_consensus.cc:348] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.420604 24645 raft_consensus.cc:374] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:32.420696 24645 raft_consensus.cc:729] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Initialized, Role: FOLLOWER
I20240502 01:54:32.420912 24645 consensus_queue.cc:260] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.421423 24645 ts_tablet_manager.cc:1398] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:54:32.427109 24651 raft_consensus.cc:686] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Becoming Leader. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:32.427249 24692 raft_consensus.cc:2781] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:32.427394 24692 raft_consensus.cc:482] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:32.427515 24692 raft_consensus.cc:3037] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.427430 24651 consensus_queue.cc:237] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
W20240502 01:54:32.428925 24418 leader_election.cc:341] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:54:32.429610 24692 raft_consensus.cc:504] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.430187 24692 leader_election.cc:288] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 election: Requested vote from peers c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.430584 24348 catalog_manager.cc:5484] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479033503eb94a9885866c04b5816950 (127.23.192.1). New cstate: current_term: 1 leader_uuid: "479033503eb94a9885866c04b5816950" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:32.431320 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3d1baa68bb4ec98e5202968129c974" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:32.431524 24603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3d1baa68bb4ec98e5202968129c974" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:32.431533 24529 raft_consensus.cc:3037] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.431717 24603 raft_consensus.cc:3037] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.433816 24529 raft_consensus.cc:2454] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 1.
I20240502 01:54:32.434141 24418 leader_election.cc:302] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.434345 24603 raft_consensus.cc:2454] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 1.
I20240502 01:54:32.434362 24692 raft_consensus.cc:2781] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:32.434535 24692 raft_consensus.cc:686] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Becoming Leader. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:32.434785 24692 consensus_queue.cc:237] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.435379 24651 raft_consensus.cc:482] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:32.435519 24651 raft_consensus.cc:504] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.436496 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3632444491e435d90d8f4b6301654cb" is_pre_election: true
I20240502 01:54:32.437047 24348 catalog_manager.cc:5484] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479033503eb94a9885866c04b5816950 (127.23.192.1). New cstate: current_term: 1 leader_uuid: "479033503eb94a9885866c04b5816950" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:32.437777 24651 leader_election.cc:288] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.438230 24603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443" is_pre_election: true
I20240502 01:54:32.438501 24603 raft_consensus.cc:2379] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 479033503eb94a9885866c04b5816950 in current term 1: Already voted for candidate c3632444491e435d90d8f4b6301654cb in this term.
I20240502 01:54:32.438884 24418 leader_election.cc:302] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 479033503eb94a9885866c04b5816950; no voters: 733acd5a64dd410f87531ab9bb22e443, c3632444491e435d90d8f4b6301654cb
I20240502 01:54:32.439524 24651 raft_consensus.cc:3037] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.441279 24651 raft_consensus.cc:2726] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:54:32.465961 24651 raft_consensus.cc:482] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:32.466149 24651 raft_consensus.cc:504] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.466758 24651 leader_election.cc:288] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.467242 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bbaf2cb89774b03ac4233ef5575f7fe" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3632444491e435d90d8f4b6301654cb" is_pre_election: true
I20240502 01:54:32.467386 24603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bbaf2cb89774b03ac4233ef5575f7fe" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443" is_pre_election: true
I20240502 01:54:32.467494 24529 raft_consensus.cc:2454] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 0.
I20240502 01:54:32.467600 24603 raft_consensus.cc:2454] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 0.
I20240502 01:54:32.467866 24418 leader_election.cc:302] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.468194 24651 raft_consensus.cc:2781] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:32.468305 24651 raft_consensus.cc:482] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:32.468425 24651 raft_consensus.cc:3037] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.471091 24651 raft_consensus.cc:504] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.471688 24651 leader_election.cc:288] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 election: Requested vote from peers c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.471982 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bbaf2cb89774b03ac4233ef5575f7fe" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:32.472191 24529 raft_consensus.cc:3037] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.472138 24603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bbaf2cb89774b03ac4233ef5575f7fe" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:32.472417 24603 raft_consensus.cc:3037] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.474288 24529 raft_consensus.cc:2454] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 1.
I20240502 01:54:32.474416 24603 raft_consensus.cc:2454] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 1.
I20240502 01:54:32.474615 24418 leader_election.cc:302] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.474890 24651 raft_consensus.cc:2781] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:32.475055 24651 raft_consensus.cc:686] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Becoming Leader. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:32.475281 24651 consensus_queue.cc:237] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.477550 24348 catalog_manager.cc:5484] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 reported cstate change: term changed from 0 to 1, leader changed from <none> to 479033503eb94a9885866c04b5816950 (127.23.192.1). New cstate: current_term: 1 leader_uuid: "479033503eb94a9885866c04b5816950" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:32.497838 24652 raft_consensus.cc:482] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:32.497975 24652 raft_consensus.cc:504] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.498473 24652 leader_election.cc:288] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.498903 24603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7524737028cb46daa68e14e1240e7a07" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443" is_pre_election: true
I20240502 01:54:32.498876 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7524737028cb46daa68e14e1240e7a07" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950" is_pre_election: true
I20240502 01:54:32.499102 24455 raft_consensus.cc:2454] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 0.
I20240502 01:54:32.499109 24603 raft_consensus.cc:2454] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 0.
I20240502 01:54:32.499457 24496 leader_election.cc:302] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.499717 24652 raft_consensus.cc:2781] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:32.499800 24652 raft_consensus.cc:482] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:32.499907 24652 raft_consensus.cc:3037] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.501564 24652 raft_consensus.cc:504] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.502074 24652 leader_election.cc:288] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.502406 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7524737028cb46daa68e14e1240e7a07" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:32.502457 24603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7524737028cb46daa68e14e1240e7a07" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:32.502560 24455 raft_consensus.cc:3037] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.502622 24603 raft_consensus.cc:3037] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.504451 24455 raft_consensus.cc:2454] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 1.
I20240502 01:54:32.504622 24603 raft_consensus.cc:2454] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 1.
I20240502 01:54:32.504805 24496 leader_election.cc:302] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.505069 24652 raft_consensus.cc:2781] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:32.505234 24652 raft_consensus.cc:686] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Becoming Leader. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:32.505445 24652 consensus_queue.cc:237] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.507630 24348 catalog_manager.cc:5484] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c3632444491e435d90d8f4b6301654cb (127.23.192.2). New cstate: current_term: 1 leader_uuid: "c3632444491e435d90d8f4b6301654cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:32.541074 24652 raft_consensus.cc:482] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:32.541200 24652 raft_consensus.cc:504] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.541719 24652 leader_election.cc:288] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.541997 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950" is_pre_election: true
I20240502 01:54:32.542100 24603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "733acd5a64dd410f87531ab9bb22e443" is_pre_election: true
I20240502 01:54:32.542198 24455 raft_consensus.cc:2379] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3632444491e435d90d8f4b6301654cb in current term 1: Already voted for candidate 733acd5a64dd410f87531ab9bb22e443 in this term.
I20240502 01:54:32.542590 24496 leader_election.cc:302] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3632444491e435d90d8f4b6301654cb; no voters: 479033503eb94a9885866c04b5816950, 733acd5a64dd410f87531ab9bb22e443
I20240502 01:54:32.542819 24652 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.544679 24652 raft_consensus.cc:2726] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:54:32.602998 24529 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "481b1a040e2f495eaac60225b0897684"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
mode: GRACEFUL
new_leader_uuid: "479033503eb94a9885866c04b5816950"
from {username='slave'} at 127.0.0.1:48072
I20240502 01:54:32.603274 24529 raft_consensus.cc:595] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Received request to transfer leadership to TS 479033503eb94a9885866c04b5816950
I20240502 01:54:32.611660 24603 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6"
dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
mode: GRACEFUL
new_leader_uuid: "479033503eb94a9885866c04b5816950"
from {username='slave'} at 127.0.0.1:37496
I20240502 01:54:32.611860 24603 raft_consensus.cc:595] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 1 LEADER]: Received request to transfer leadership to TS 479033503eb94a9885866c04b5816950
I20240502 01:54:32.618009 24455 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "64f8d56b12f8455b892a3c1d88e20c3e"
dest_uuid: "479033503eb94a9885866c04b5816950"
mode: GRACEFUL
new_leader_uuid: "c3632444491e435d90d8f4b6301654cb"
from {username='slave'} at 127.0.0.1:48370
I20240502 01:54:32.618201 24455 raft_consensus.cc:595] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Received request to transfer leadership to TS c3632444491e435d90d8f4b6301654cb
I20240502 01:54:32.796877 24654 consensus_queue.cc:1035] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.801707 24654 consensus_queue.cc:1035] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.804926 24678 raft_consensus.cc:979] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443: : Instructing follower 479033503eb94a9885866c04b5816950 to start an election
I20240502 01:54:32.805143 24654 raft_consensus.cc:1067] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 1 LEADER]: Signalling peer 479033503eb94a9885866c04b5816950 to start an election
I20240502 01:54:32.806128 24455 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6"
dest_uuid: "479033503eb94a9885866c04b5816950"
from {username='slave'} at 127.0.0.1:48364
I20240502 01:54:32.806370 24455 raft_consensus.cc:482] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:32.806491 24455 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:32.808920 24455 raft_consensus.cc:504] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.809481 24455 leader_election.cc:288] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 2 election: Requested vote from peers c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.809841 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:32.810003 24529 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:32.810029 24603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:32.810246 24603 raft_consensus.cc:3032] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:54:32.810321 24603 raft_consensus.cc:729] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Running, Role: LEADER
I20240502 01:54:32.810619 24603 consensus_queue.cc:260] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.811146 24603 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:32.812134 24529 raft_consensus.cc:2454] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 2.
I20240502 01:54:32.812511 24418 leader_election.cc:302] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.812810 24651 raft_consensus.cc:2781] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:54:32.812951 24651 raft_consensus.cc:686] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 2 LEADER]: Becoming Leader. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:32.813184 24651 consensus_queue.cc:237] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.813248 24603 raft_consensus.cc:2454] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 2.
I20240502 01:54:32.815153 24348 catalog_manager.cc:5484] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 reported cstate change: term changed from 1 to 2, leader changed from 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3) to 479033503eb94a9885866c04b5816950 (127.23.192.1). New cstate: current_term: 2 leader_uuid: "479033503eb94a9885866c04b5816950" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:32.825785 24654 raft_consensus.cc:482] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:32.825938 24654 raft_consensus.cc:504] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.826385 24654 leader_election.cc:288] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977)
I20240502 01:54:32.826753 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ae222544203452aa1402c768b9c0cea" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3632444491e435d90d8f4b6301654cb" is_pre_election: true
I20240502 01:54:32.826809 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ae222544203452aa1402c768b9c0cea" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "479033503eb94a9885866c04b5816950" is_pre_election: true
I20240502 01:54:32.827075 24455 raft_consensus.cc:2379] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 733acd5a64dd410f87531ab9bb22e443 in current term 1: Already voted for candidate c3632444491e435d90d8f4b6301654cb in this term.
I20240502 01:54:32.827440 24570 leader_election.cc:302] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 733acd5a64dd410f87531ab9bb22e443; no voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb
I20240502 01:54:32.827699 24654 raft_consensus.cc:3037] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.829342 24652 consensus_queue.cc:1035] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.829679 24654 raft_consensus.cc:2726] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:54:32.833122 24666 consensus_queue.cc:1035] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.836057 24666 raft_consensus.cc:979] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb: : Instructing follower 479033503eb94a9885866c04b5816950 to start an election
I20240502 01:54:32.836227 24666 raft_consensus.cc:1067] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Signalling peer 479033503eb94a9885866c04b5816950 to start an election
I20240502 01:54:32.836817 24455 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "481b1a040e2f495eaac60225b0897684"
dest_uuid: "479033503eb94a9885866c04b5816950"
from {username='slave'} at 127.0.0.1:48360
I20240502 01:54:32.836974 24455 raft_consensus.cc:482] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:32.837134 24455 raft_consensus.cc:3037] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:32.837831 24692 consensus_queue.cc:1035] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.839612 24455 raft_consensus.cc:504] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:32.839727 24666 consensus_queue.cc:1035] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.840909 24455 leader_election.cc:288] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 2 election: Requested vote from peers 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489), c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977)
I20240502 01:54:32.841831 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "481b1a040e2f495eaac60225b0897684" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:32.842031 24529 raft_consensus.cc:3032] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:54:32.842147 24529 raft_consensus.cc:729] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:32.842407 24529 consensus_queue.cc:260] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:32.842767 24529 raft_consensus.cc:3037] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:32.842672 24691 consensus_queue.cc:1035] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.845711 24529 raft_consensus.cc:2454] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 2.
I20240502 01:54:32.846114 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "481b1a040e2f495eaac60225b0897684" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:32.846308 24604 raft_consensus.cc:3037] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:32.848572 24418 leader_election.cc:302] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.848820 24691 raft_consensus.cc:2781] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:54:32.849020 24691 raft_consensus.cc:686] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 2 LEADER]: Becoming Leader. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:32.849339 24691 consensus_queue.cc:237] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:32.849985 24705 consensus_queue.cc:1035] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.850755 24604 raft_consensus.cc:2454] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 2.
I20240502 01:54:32.854295 24348 catalog_manager.cc:5484] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 reported cstate change: term changed from 1 to 2, leader changed from c3632444491e435d90d8f4b6301654cb (127.23.192.2) to 479033503eb94a9885866c04b5816950 (127.23.192.1). New cstate: current_term: 2 leader_uuid: "479033503eb94a9885866c04b5816950" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: HEALTHY } } }
I20240502 01:54:32.862885 24603 raft_consensus.cc:3037] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:32.865682 24651 consensus_queue.cc:1035] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.869812 24692 consensus_queue.cc:1035] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.872401 24651 raft_consensus.cc:979] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950: : Instructing follower c3632444491e435d90d8f4b6301654cb to start an election
I20240502 01:54:32.872546 24651 raft_consensus.cc:1067] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Signalling peer c3632444491e435d90d8f4b6301654cb to start an election
I20240502 01:54:32.872640 24705 consensus_queue.cc:1035] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.873186 24530 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "64f8d56b12f8455b892a3c1d88e20c3e"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
from {username='slave'} at 127.0.0.1:48070
I20240502 01:54:32.873391 24530 raft_consensus.cc:482] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:32.873512 24530 raft_consensus.cc:3037] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:32.876083 24530 raft_consensus.cc:504] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.876655 24652 consensus_queue.cc:1035] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.877532 24603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64f8d56b12f8455b892a3c1d88e20c3e" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:32.877728 24603 raft_consensus.cc:3037] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:32.879487 24654 consensus_queue.cc:1035] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.880203 24603 raft_consensus.cc:2454] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 2.
I20240502 01:54:32.880749 24494 leader_election.cc:302] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 733acd5a64dd410f87531ab9bb22e443, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:32.881042 24530 leader_election.cc:288] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 2 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:32.881067 24666 raft_consensus.cc:2781] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:54:32.881269 24666 raft_consensus.cc:686] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Becoming Leader. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:32.881564 24666 consensus_queue.cc:237] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.882974 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64f8d56b12f8455b892a3c1d88e20c3e" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:32.883132 24455 raft_consensus.cc:3032] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:54:32.883210 24455 raft_consensus.cc:729] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:32.883428 24455 consensus_queue.cc:260] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:32.883718 24455 raft_consensus.cc:3037] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:32.886636 24455 raft_consensus.cc:2454] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 2.
I20240502 01:54:32.887518 24678 consensus_queue.cc:1035] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.888970 24349 catalog_manager.cc:5484] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb reported cstate change: term changed from 1 to 2, leader changed from 479033503eb94a9885866c04b5816950 (127.23.192.1) to c3632444491e435d90d8f4b6301654cb (127.23.192.2). New cstate: current_term: 2 leader_uuid: "c3632444491e435d90d8f4b6301654cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:32.906555 24652 consensus_queue.cc:1035] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:32.909917 24666 consensus_queue.cc:1035] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:33.036754 24692 consensus_queue.cc:1035] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:33.040808 24651 consensus_queue.cc:1035] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:33.291806 24603 raft_consensus.cc:1261] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Refusing update from remote peer c3632444491e435d90d8f4b6301654cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:54:33.292328 24666 consensus_queue.cc:1035] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:54:33.295070 24454 raft_consensus.cc:1261] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Refusing update from remote peer c3632444491e435d90d8f4b6301654cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:54:33.295760 24652 consensus_queue.cc:1035] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:54:33.327661 24529 raft_consensus.cc:1261] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Refusing update from remote peer 479033503eb94a9885866c04b5816950: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:54:33.328101 24692 consensus_queue.cc:1035] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:54:33.330001 24529 raft_consensus.cc:1261] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Refusing update from remote peer 479033503eb94a9885866c04b5816950: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:54:33.330585 24651 consensus_queue.cc:1035] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:54:33.331475 24603 raft_consensus.cc:1261] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Refusing update from remote peer 479033503eb94a9885866c04b5816950: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:54:33.332106 24651 consensus_queue.cc:1035] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:54:33.333961 24604 raft_consensus.cc:1261] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Refusing update from remote peer 479033503eb94a9885866c04b5816950: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:54:33.334647 24691 consensus_queue.cc:1035] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:54:35.631670 24320 auto_leader_rebalancer-test.cc:261] The leader distribution is
I20240502 01:54:35.632046 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:35.639753 24530 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
mode: GRACEFUL
new_leader_uuid: "733acd5a64dd410f87531ab9bb22e443"
from {username='slave'} at 127.0.0.1:48086
I20240502 01:54:35.639938 24530 raft_consensus.cc:595] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Received request to transfer leadership to TS 733acd5a64dd410f87531ab9bb22e443
I20240502 01:54:35.645988 24454 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6"
dest_uuid: "479033503eb94a9885866c04b5816950"
mode: GRACEFUL
new_leader_uuid: "733acd5a64dd410f87531ab9bb22e443"
from {username='slave'} at 127.0.0.1:48378
I20240502 01:54:35.646147 24454 raft_consensus.cc:595] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 2 LEADER]: Received request to transfer leadership to TS 733acd5a64dd410f87531ab9bb22e443
I20240502 01:54:35.646560 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240502 01:54:35.646788 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:35.774675 24652 raft_consensus.cc:979] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb: : Instructing follower 733acd5a64dd410f87531ab9bb22e443 to start an election
I20240502 01:54:35.774852 24652 raft_consensus.cc:1067] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Signalling peer 733acd5a64dd410f87531ab9bb22e443 to start an election
I20240502 01:54:35.775465 24604 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d"
dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
from {username='slave'} at 127.0.0.1:37466
I20240502 01:54:35.775662 24604 raft_consensus.cc:482] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:35.775766 24604 raft_consensus.cc:3037] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:35.781599 24604 raft_consensus.cc:504] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:35.782233 24604 leader_election.cc:288] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 2 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977)
I20240502 01:54:35.782636 24454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:35.782757 24530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:35.782902 24454 raft_consensus.cc:3037] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:35.782999 24530 raft_consensus.cc:3032] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:54:35.783100 24530 raft_consensus.cc:729] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:35.783339 24530 consensus_queue.cc:260] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:35.783664 24530 raft_consensus.cc:3037] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:35.785065 24454 raft_consensus.cc:2454] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 2.
I20240502 01:54:35.785477 24570 leader_election.cc:302] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, 733acd5a64dd410f87531ab9bb22e443; no voters:
I20240502 01:54:35.785745 24678 raft_consensus.cc:2781] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:54:35.785765 24530 raft_consensus.cc:2454] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 2.
I20240502 01:54:35.786187 24678 raft_consensus.cc:686] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 2 LEADER]: Becoming Leader. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Running, Role: LEADER
I20240502 01:54:35.786459 24678 consensus_queue.cc:237] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:35.788931 24348 catalog_manager.cc:5484] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 reported cstate change: term changed from 1 to 2, leader changed from c3632444491e435d90d8f4b6301654cb (127.23.192.2) to 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3). New cstate: current_term: 2 leader_uuid: "733acd5a64dd410f87531ab9bb22e443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: HEALTHY } } }
I20240502 01:54:35.870242 24692 raft_consensus.cc:979] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950: : Instructing follower 733acd5a64dd410f87531ab9bb22e443 to start an election
I20240502 01:54:35.870374 24692 raft_consensus.cc:1067] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 2 LEADER]: Signalling peer 733acd5a64dd410f87531ab9bb22e443 to start an election
I20240502 01:54:35.870920 24604 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6"
dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
from {username='slave'} at 127.0.0.1:37482
I20240502 01:54:35.871090 24604 raft_consensus.cc:482] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:35.871210 24604 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:35.873538 24604 raft_consensus.cc:504] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:35.874209 24604 leader_election.cc:288] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 3 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977)
I20240502 01:54:35.874630 24530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:35.874629 24454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:35.874876 24530 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:35.874897 24454 raft_consensus.cc:3032] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 01:54:35.874989 24454 raft_consensus.cc:729] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:35.875262 24454 consensus_queue.cc:260] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:35.875640 24454 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:35.877717 24530 raft_consensus.cc:2454] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 3.
I20240502 01:54:35.878082 24568 leader_election.cc:302] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 733acd5a64dd410f87531ab9bb22e443, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:35.878219 24454 raft_consensus.cc:2454] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 3.
I20240502 01:54:35.878341 24678 raft_consensus.cc:2781] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:54:35.878508 24678 raft_consensus.cc:686] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 3 LEADER]: Becoming Leader. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Running, Role: LEADER
I20240502 01:54:35.878772 24678 consensus_queue.cc:237] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:35.881292 24348 catalog_manager.cc:5484] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 reported cstate change: term changed from 2 to 3, leader changed from 479033503eb94a9885866c04b5816950 (127.23.192.1) to 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3). New cstate: current_term: 3 leader_uuid: "733acd5a64dd410f87531ab9bb22e443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: HEALTHY } } }
I20240502 01:54:36.286173 24454 raft_consensus.cc:1261] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Refusing update from remote peer 733acd5a64dd410f87531ab9bb22e443: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:54:36.286701 24678 consensus_queue.cc:1035] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:54:36.295926 24530 raft_consensus.cc:1261] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Refusing update from remote peer 733acd5a64dd410f87531ab9bb22e443: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:54:36.296445 24678 consensus_queue.cc:1035] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:54:36.371062 24530 raft_consensus.cc:1261] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Refusing update from remote peer 733acd5a64dd410f87531ab9bb22e443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:54:36.371527 24678 consensus_queue.cc:1035] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:54:36.374513 24454 raft_consensus.cc:1261] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Refusing update from remote peer 733acd5a64dd410f87531ab9bb22e443: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:54:36.375051 24737 consensus_queue.cc:1035] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:54:36.647157 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:36.648734 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:36.648929 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:37.663439 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:37.664955 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:37.665129 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:38.665506 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:38.667102 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:38.667305 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:39.667685 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:39.669273 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:39.669462 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:40.669929 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:40.671876 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:40.672089 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:41.672448 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:41.673985 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:41.674171 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:42.674538 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:42.676133 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:42.676333 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:43.676707 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:43.678453 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:43.678638 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:44.678999 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:44.680541 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:44.680737 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:45.690611 24320 auto_leader_rebalancer-test.cc:280] The leader distribution is
I20240502 01:54:45.692479 24454 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "481b1a040e2f495eaac60225b0897684"
dest_uuid: "479033503eb94a9885866c04b5816950"
mode: GRACEFUL
new_leader_uuid: "c3632444491e435d90d8f4b6301654cb"
from {username='slave'} at 127.0.0.1:48370
I20240502 01:54:45.692700 24454 raft_consensus.cc:595] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 2 LEADER]: Received request to transfer leadership to TS c3632444491e435d90d8f4b6301654cb
I20240502 01:54:45.694664 24455 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8bbaf2cb89774b03ac4233ef5575f7fe"
dest_uuid: "479033503eb94a9885866c04b5816950"
mode: GRACEFUL
new_leader_uuid: "c3632444491e435d90d8f4b6301654cb"
from {username='slave'} at 127.0.0.1:48370
I20240502 01:54:45.694908 24455 raft_consensus.cc:595] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Received request to transfer leadership to TS c3632444491e435d90d8f4b6301654cb
I20240502 01:54:45.696734 24455 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ac3d1baa68bb4ec98e5202968129c974"
dest_uuid: "479033503eb94a9885866c04b5816950"
mode: GRACEFUL
new_leader_uuid: "c3632444491e435d90d8f4b6301654cb"
from {username='slave'} at 127.0.0.1:48370
I20240502 01:54:45.696924 24455 raft_consensus.cc:595] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Received request to transfer leadership to TS c3632444491e435d90d8f4b6301654cb
I20240502 01:54:45.698778 24604 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6"
dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
mode: GRACEFUL
new_leader_uuid: "c3632444491e435d90d8f4b6301654cb"
from {username='slave'} at 127.0.0.1:37496
I20240502 01:54:45.698956 24604 raft_consensus.cc:595] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 3 LEADER]: Received request to transfer leadership to TS c3632444491e435d90d8f4b6301654cb
I20240502 01:54:45.703819 24604 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d"
dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
mode: GRACEFUL
new_leader_uuid: "c3632444491e435d90d8f4b6301654cb"
from {username='slave'} at 127.0.0.1:37496
I20240502 01:54:45.703982 24604 raft_consensus.cc:595] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 2 LEADER]: Received request to transfer leadership to TS c3632444491e435d90d8f4b6301654cb
I20240502 01:54:45.773749 24732 raft_consensus.cc:979] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950: : Instructing follower c3632444491e435d90d8f4b6301654cb to start an election
I20240502 01:54:45.773917 24732 raft_consensus.cc:1067] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 2 LEADER]: Signalling peer c3632444491e435d90d8f4b6301654cb to start an election
I20240502 01:54:45.774529 24529 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "481b1a040e2f495eaac60225b0897684"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
from {username='slave'} at 127.0.0.1:48070
I20240502 01:54:45.774724 24529 raft_consensus.cc:482] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:45.774868 24529 raft_consensus.cc:3037] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:45.776798 24529 raft_consensus.cc:504] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:45.777340 24529 leader_election.cc:288] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 3 election: Requested vote from peers 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489), 479033503eb94a9885866c04b5816950 (127.23.192.1:37437)
I20240502 01:54:45.777742 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "481b1a040e2f495eaac60225b0897684" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:45.777806 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "481b1a040e2f495eaac60225b0897684" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:45.777969 24455 raft_consensus.cc:3032] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 01:54:45.777992 24604 raft_consensus.cc:3037] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:45.778079 24455 raft_consensus.cc:729] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:45.778348 24455 consensus_queue.cc:260] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:45.778728 24455 raft_consensus.cc:3037] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:45.780848 24604 raft_consensus.cc:2454] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 3.
I20240502 01:54:45.781263 24455 raft_consensus.cc:2454] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 3.
I20240502 01:54:45.781268 24494 leader_election.cc:302] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 733acd5a64dd410f87531ab9bb22e443, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:45.781598 24745 raft_consensus.cc:2781] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:54:45.782021 24745 raft_consensus.cc:686] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 3 LEADER]: Becoming Leader. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:45.782348 24745 consensus_queue.cc:237] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } }
I20240502 01:54:45.785058 24348 catalog_manager.cc:5484] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb reported cstate change: term changed from 2 to 3, leader changed from 479033503eb94a9885866c04b5816950 (127.23.192.1) to c3632444491e435d90d8f4b6301654cb (127.23.192.2). New cstate: current_term: 3 leader_uuid: "c3632444491e435d90d8f4b6301654cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:45.833057 24744 raft_consensus.cc:979] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443: : Instructing follower c3632444491e435d90d8f4b6301654cb to start an election
I20240502 01:54:45.833195 24744 raft_consensus.cc:1067] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 3 LEADER]: Signalling peer c3632444491e435d90d8f4b6301654cb to start an election
I20240502 01:54:45.833778 24529 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
from {username='slave'} at 127.0.0.1:48062
I20240502 01:54:45.833945 24529 raft_consensus.cc:482] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:45.834036 24529 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:54:45.836222 24529 raft_consensus.cc:504] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:45.836719 24529 leader_election.cc:288] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 4 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:45.837105 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:45.837129 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:45.837333 24604 raft_consensus.cc:3032] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 01:54:45.837342 24455 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:54:45.837453 24604 raft_consensus.cc:729] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Running, Role: LEADER
I20240502 01:54:45.837697 24604 consensus_queue.cc:260] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:45.838085 24604 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:54:45.840142 24455 raft_consensus.cc:2454] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 4.
I20240502 01:54:45.840477 24496 leader_election.cc:302] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:45.840775 24745 raft_consensus.cc:2781] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 4 FOLLOWER]: Leader election won for term 4
I20240502 01:54:45.840943 24745 raft_consensus.cc:686] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 4 LEADER]: Becoming Leader. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:45.841185 24745 consensus_queue.cc:237] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:45.841289 24604 raft_consensus.cc:2454] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 4.
I20240502 01:54:45.843660 24348 catalog_manager.cc:5484] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb reported cstate change: term changed from 3 to 4, leader changed from 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3) to c3632444491e435d90d8f4b6301654cb (127.23.192.2). New cstate: current_term: 4 leader_uuid: "c3632444491e435d90d8f4b6301654cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:46.110358 24746 raft_consensus.cc:979] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950: : Instructing follower c3632444491e435d90d8f4b6301654cb to start an election
I20240502 01:54:46.110513 24746 raft_consensus.cc:1067] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Signalling peer c3632444491e435d90d8f4b6301654cb to start an election
I20240502 01:54:46.111213 24529 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ac3d1baa68bb4ec98e5202968129c974"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
from {username='slave'} at 127.0.0.1:48070
I20240502 01:54:46.111402 24529 raft_consensus.cc:482] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:46.111532 24529 raft_consensus.cc:3037] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:46.113463 24529 raft_consensus.cc:504] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:46.114091 24529 leader_election.cc:288] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 2 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:46.114483 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3d1baa68bb4ec98e5202968129c974" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:46.114562 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3d1baa68bb4ec98e5202968129c974" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:46.114670 24455 raft_consensus.cc:3032] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:54:46.114789 24455 raft_consensus.cc:729] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:46.114807 24604 raft_consensus.cc:3037] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:46.115072 24455 consensus_queue.cc:260] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:46.115404 24455 raft_consensus.cc:3037] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:46.116851 24604 raft_consensus.cc:2454] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 2.
I20240502 01:54:46.117249 24494 leader_election.cc:302] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 733acd5a64dd410f87531ab9bb22e443, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:46.117368 24455 raft_consensus.cc:2454] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 2.
I20240502 01:54:46.117583 24745 raft_consensus.cc:2781] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:54:46.117755 24745 raft_consensus.cc:686] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Becoming Leader. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:46.118039 24745 consensus_queue.cc:237] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:46.120429 24348 catalog_manager.cc:5484] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb reported cstate change: term changed from 1 to 2, leader changed from 479033503eb94a9885866c04b5816950 (127.23.192.1) to c3632444491e435d90d8f4b6301654cb (127.23.192.2). New cstate: current_term: 2 leader_uuid: "c3632444491e435d90d8f4b6301654cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:46.178927 24732 raft_consensus.cc:979] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950: : Instructing follower c3632444491e435d90d8f4b6301654cb to start an election
I20240502 01:54:46.179086 24732 raft_consensus.cc:1067] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Signalling peer c3632444491e435d90d8f4b6301654cb to start an election
I20240502 01:54:46.179632 24529 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8bbaf2cb89774b03ac4233ef5575f7fe"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
from {username='slave'} at 127.0.0.1:48070
I20240502 01:54:46.179796 24529 raft_consensus.cc:482] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:46.179874 24529 raft_consensus.cc:3037] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:46.181586 24529 raft_consensus.cc:504] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:46.182073 24529 leader_election.cc:288] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 2 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:46.182448 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bbaf2cb89774b03ac4233ef5575f7fe" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:46.182612 24455 raft_consensus.cc:3032] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:54:46.182552 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bbaf2cb89774b03ac4233ef5575f7fe" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:46.182718 24455 raft_consensus.cc:729] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:46.182786 24604 raft_consensus.cc:3037] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:46.182984 24455 consensus_queue.cc:260] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:46.183292 24455 raft_consensus.cc:3037] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:54:46.185009 24604 raft_consensus.cc:2454] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 2.
I20240502 01:54:46.185341 24455 raft_consensus.cc:2454] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 2.
I20240502 01:54:46.185331 24494 leader_election.cc:302] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 733acd5a64dd410f87531ab9bb22e443, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:46.185648 24745 raft_consensus.cc:2781] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:54:46.185828 24745 raft_consensus.cc:686] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Becoming Leader. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:46.186157 24745 consensus_queue.cc:237] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:46.188730 24348 catalog_manager.cc:5484] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb reported cstate change: term changed from 1 to 2, leader changed from 479033503eb94a9885866c04b5816950 (127.23.192.1) to c3632444491e435d90d8f4b6301654cb (127.23.192.2). New cstate: current_term: 2 leader_uuid: "c3632444491e435d90d8f4b6301654cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:46.207753 24753 raft_consensus.cc:979] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443: : Instructing follower c3632444491e435d90d8f4b6301654cb to start an election
I20240502 01:54:46.207890 24753 raft_consensus.cc:1067] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 2 LEADER]: Signalling peer c3632444491e435d90d8f4b6301654cb to start an election
I20240502 01:54:46.208454 24529 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
from {username='slave'} at 127.0.0.1:48062
I20240502 01:54:46.208609 24529 raft_consensus.cc:482] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:46.208724 24529 raft_consensus.cc:3037] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:46.210489 24529 raft_consensus.cc:504] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:46.211021 24529 leader_election.cc:288] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 3 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:46.211390 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:46.211432 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d" candidate_uuid: "c3632444491e435d90d8f4b6301654cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:46.211549 24455 raft_consensus.cc:3037] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:46.211589 24604 raft_consensus.cc:3032] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 01:54:46.211678 24604 raft_consensus.cc:729] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Running, Role: LEADER
I20240502 01:54:46.211908 24604 consensus_queue.cc:260] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:46.212244 24604 raft_consensus.cc:3037] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:46.213477 24455 raft_consensus.cc:2454] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 3.
I20240502 01:54:46.213840 24496 leader_election.cc:302] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, c3632444491e435d90d8f4b6301654cb; no voters:
I20240502 01:54:46.214148 24745 raft_consensus.cc:2781] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:54:46.214264 24604 raft_consensus.cc:2454] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3632444491e435d90d8f4b6301654cb in term 3.
I20240502 01:54:46.214303 24745 raft_consensus.cc:686] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 3 LEADER]: Becoming Leader. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:46.214561 24745 consensus_queue.cc:237] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:46.216817 24348 catalog_manager.cc:5484] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb reported cstate change: term changed from 2 to 3, leader changed from 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3) to c3632444491e435d90d8f4b6301654cb (127.23.192.2). New cstate: current_term: 3 leader_uuid: "c3632444491e435d90d8f4b6301654cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:46.315481 24604 raft_consensus.cc:1261] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 4 FOLLOWER]: Refusing update from remote peer c3632444491e435d90d8f4b6301654cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 01:54:46.315979 24745 consensus_queue.cc:1035] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:54:46.319931 24455 raft_consensus.cc:1261] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 4 FOLLOWER]: Refusing update from remote peer c3632444491e435d90d8f4b6301654cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 01:54:46.320796 24747 consensus_queue.cc:1035] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:54:46.331591 24455 raft_consensus.cc:1261] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Refusing update from remote peer c3632444491e435d90d8f4b6301654cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:54:46.332000 24747 consensus_queue.cc:1035] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:54:46.334849 24604 raft_consensus.cc:1261] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Refusing update from remote peer c3632444491e435d90d8f4b6301654cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:54:46.335477 24745 consensus_queue.cc:1035] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:54:46.571106 24455 raft_consensus.cc:1261] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Refusing update from remote peer c3632444491e435d90d8f4b6301654cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:54:46.571771 24765 consensus_queue.cc:1035] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:54:46.575948 24604 raft_consensus.cc:1261] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Refusing update from remote peer c3632444491e435d90d8f4b6301654cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:54:46.576603 24747 consensus_queue.cc:1035] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:54:46.611570 24455 raft_consensus.cc:1261] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Refusing update from remote peer c3632444491e435d90d8f4b6301654cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:54:46.612105 24747 consensus_queue.cc:1035] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:54:46.615280 24604 raft_consensus.cc:1261] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Refusing update from remote peer c3632444491e435d90d8f4b6301654cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:54:46.616864 24764 consensus_queue.cc:1035] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:54:46.661020 24604 raft_consensus.cc:1261] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Refusing update from remote peer c3632444491e435d90d8f4b6301654cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:54:46.661468 24764 consensus_queue.cc:1035] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:54:46.664614 24455 raft_consensus.cc:1261] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Refusing update from remote peer c3632444491e435d90d8f4b6301654cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:54:46.665261 24765 consensus_queue.cc:1035] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:54:48.714669 24320 auto_leader_rebalancer-test.cc:295] The leader distribution is
I20240502 01:54:48.714947 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:48.717034 24529 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "64f8d56b12f8455b892a3c1d88e20c3e"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
mode: GRACEFUL
new_leader_uuid: "479033503eb94a9885866c04b5816950"
from {username='slave'} at 127.0.0.1:48086
I20240502 01:54:48.717255 24529 raft_consensus.cc:595] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Received request to transfer leadership to TS 479033503eb94a9885866c04b5816950
I20240502 01:54:48.718185 24529 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
mode: GRACEFUL
new_leader_uuid: "733acd5a64dd410f87531ab9bb22e443"
from {username='slave'} at 127.0.0.1:48086
I20240502 01:54:48.718370 24529 raft_consensus.cc:595] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 3 LEADER]: Received request to transfer leadership to TS 733acd5a64dd410f87531ab9bb22e443
I20240502 01:54:48.719167 24529 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8bbaf2cb89774b03ac4233ef5575f7fe"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
mode: GRACEFUL
new_leader_uuid: "479033503eb94a9885866c04b5816950"
from {username='slave'} at 127.0.0.1:48086
I20240502 01:54:48.719331 24529 raft_consensus.cc:595] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Received request to transfer leadership to TS 479033503eb94a9885866c04b5816950
I20240502 01:54:48.720171 24529 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ac3d1baa68bb4ec98e5202968129c974"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
mode: GRACEFUL
new_leader_uuid: "733acd5a64dd410f87531ab9bb22e443"
from {username='slave'} at 127.0.0.1:48086
I20240502 01:54:48.720333 24529 raft_consensus.cc:595] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Received request to transfer leadership to TS 733acd5a64dd410f87531ab9bb22e443
I20240502 01:54:48.721134 24529 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6"
dest_uuid: "c3632444491e435d90d8f4b6301654cb"
mode: GRACEFUL
new_leader_uuid: "479033503eb94a9885866c04b5816950"
from {username='slave'} at 127.0.0.1:48086
I20240502 01:54:48.721298 24529 raft_consensus.cc:595] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 4 LEADER]: Received request to transfer leadership to TS 479033503eb94a9885866c04b5816950
I20240502 01:54:48.721681 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 5
I20240502 01:54:48.721884 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:48.777309 24765 raft_consensus.cc:979] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb: : Instructing follower 733acd5a64dd410f87531ab9bb22e443 to start an election
I20240502 01:54:48.777444 24765 raft_consensus.cc:1067] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Signalling peer 733acd5a64dd410f87531ab9bb22e443 to start an election
I20240502 01:54:48.777971 24604 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ac3d1baa68bb4ec98e5202968129c974"
dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
from {username='slave'} at 127.0.0.1:37466
I20240502 01:54:48.778148 24604 raft_consensus.cc:482] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:48.778229 24604 raft_consensus.cc:3037] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:48.780107 24604 raft_consensus.cc:504] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:48.780791 24604 leader_election.cc:288] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 3 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977)
I20240502 01:54:48.781220 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3d1baa68bb4ec98e5202968129c974" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:48.781275 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3d1baa68bb4ec98e5202968129c974" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:48.781407 24455 raft_consensus.cc:3037] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:48.781481 24529 raft_consensus.cc:3032] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Stepping down as leader of term 2
I20240502 01:54:48.781571 24529 raft_consensus.cc:729] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:48.781841 24529 consensus_queue.cc:260] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:48.782153 24529 raft_consensus.cc:3037] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:48.783458 24455 raft_consensus.cc:2454] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 3.
I20240502 01:54:48.783847 24570 leader_election.cc:302] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, 733acd5a64dd410f87531ab9bb22e443; no voters:
I20240502 01:54:48.784127 24753 raft_consensus.cc:2781] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:54:48.784207 24529 raft_consensus.cc:2454] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 3.
I20240502 01:54:48.784530 24753 raft_consensus.cc:686] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 3 LEADER]: Becoming Leader. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Running, Role: LEADER
I20240502 01:54:48.784821 24753 consensus_queue.cc:237] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:48.787007 24349 catalog_manager.cc:5484] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 reported cstate change: term changed from 2 to 3, leader changed from c3632444491e435d90d8f4b6301654cb (127.23.192.2) to 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3). New cstate: current_term: 3 leader_uuid: "733acd5a64dd410f87531ab9bb22e443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: HEALTHY } } }
I20240502 01:54:48.936527 24765 raft_consensus.cc:979] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb: : Instructing follower 479033503eb94a9885866c04b5816950 to start an election
I20240502 01:54:48.936723 24773 raft_consensus.cc:1067] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Signalling peer 479033503eb94a9885866c04b5816950 to start an election
I20240502 01:54:48.937309 24455 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "64f8d56b12f8455b892a3c1d88e20c3e"
dest_uuid: "479033503eb94a9885866c04b5816950"
from {username='slave'} at 127.0.0.1:48360
I20240502 01:54:48.937489 24455 raft_consensus.cc:482] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:48.937572 24455 raft_consensus.cc:3037] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:48.939473 24455 raft_consensus.cc:504] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:48.940124 24455 leader_election.cc:288] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 3 election: Requested vote from peers c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:48.940508 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64f8d56b12f8455b892a3c1d88e20c3e" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:48.940546 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64f8d56b12f8455b892a3c1d88e20c3e" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:48.940696 24529 raft_consensus.cc:3032] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Stepping down as leader of term 2
I20240502 01:54:48.940712 24604 raft_consensus.cc:3037] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:48.940786 24529 raft_consensus.cc:729] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:48.941062 24529 consensus_queue.cc:260] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:48.941342 24529 raft_consensus.cc:3037] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:48.942818 24604 raft_consensus.cc:2454] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 3.
I20240502 01:54:48.943291 24529 raft_consensus.cc:2454] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 3.
I20240502 01:54:48.943310 24418 leader_election.cc:302] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, 733acd5a64dd410f87531ab9bb22e443; no voters:
I20240502 01:54:48.943832 24781 raft_consensus.cc:2781] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:54:48.944218 24781 raft_consensus.cc:686] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 3 LEADER]: Becoming Leader. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:48.944509 24781 consensus_queue.cc:237] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:48.946902 24349 catalog_manager.cc:5484] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 reported cstate change: term changed from 2 to 3, leader changed from c3632444491e435d90d8f4b6301654cb (127.23.192.2) to 479033503eb94a9885866c04b5816950 (127.23.192.1). New cstate: current_term: 3 leader_uuid: "479033503eb94a9885866c04b5816950" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:48.984522 24765 raft_consensus.cc:979] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb: : Instructing follower 733acd5a64dd410f87531ab9bb22e443 to start an election
I20240502 01:54:48.984665 24765 raft_consensus.cc:1067] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 3 LEADER]: Signalling peer 733acd5a64dd410f87531ab9bb22e443 to start an election
I20240502 01:54:48.985208 24604 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d"
dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
from {username='slave'} at 127.0.0.1:37466
I20240502 01:54:48.985363 24604 raft_consensus.cc:482] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:48.985441 24604 raft_consensus.cc:3037] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:54:48.987282 24604 raft_consensus.cc:504] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:48.987841 24604 leader_election.cc:288] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 4 election: Requested vote from peers 479033503eb94a9885866c04b5816950 (127.23.192.1:37437), c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977)
I20240502 01:54:48.988201 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:48.988171 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b5855189fd473d8353d300fc707d4d" candidate_uuid: "733acd5a64dd410f87531ab9bb22e443" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "479033503eb94a9885866c04b5816950"
I20240502 01:54:48.988435 24529 raft_consensus.cc:3032] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 3 LEADER]: Stepping down as leader of term 3
I20240502 01:54:48.988442 24455 raft_consensus.cc:3037] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:54:48.988523 24529 raft_consensus.cc:729] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:48.988749 24529 consensus_queue.cc:260] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:48.989035 24529 raft_consensus.cc:3037] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:54:48.990603 24455 raft_consensus.cc:2454] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 4.
I20240502 01:54:48.991008 24570 leader_election.cc:302] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, 733acd5a64dd410f87531ab9bb22e443; no voters:
I20240502 01:54:48.991186 24773 raft_consensus.cc:979] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb: : Instructing follower 479033503eb94a9885866c04b5816950 to start an election
I20240502 01:54:48.991294 24753 raft_consensus.cc:2781] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 01:54:48.991338 24773 raft_consensus.cc:1067] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 4 LEADER]: Signalling peer 479033503eb94a9885866c04b5816950 to start an election
I20240502 01:54:48.991474 24753 raft_consensus.cc:686] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 4 LEADER]: Becoming Leader. State: Replica: 733acd5a64dd410f87531ab9bb22e443, State: Running, Role: LEADER
I20240502 01:54:48.991724 24753 consensus_queue.cc:237] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:48.991902 24455 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6"
dest_uuid: "479033503eb94a9885866c04b5816950"
from {username='slave'} at 127.0.0.1:48360
I20240502 01:54:48.992081 24455 raft_consensus.cc:482] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:48.992172 24455 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 4 FOLLOWER]: Advancing to term 5
I20240502 01:54:48.992630 24529 raft_consensus.cc:2454] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 733acd5a64dd410f87531ab9bb22e443 in term 4.
I20240502 01:54:48.994268 24455 raft_consensus.cc:504] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:48.994624 24349 catalog_manager.cc:5484] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 reported cstate change: term changed from 3 to 4, leader changed from c3632444491e435d90d8f4b6301654cb (127.23.192.2) to 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3). New cstate: current_term: 4 leader_uuid: "733acd5a64dd410f87531ab9bb22e443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: HEALTHY } } }
I20240502 01:54:48.994848 24455 leader_election.cc:288] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 5 election: Requested vote from peers c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:48.995210 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:48.995216 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e22953c0a720422a9b5336ac903786e6" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:48.995409 24529 raft_consensus.cc:3032] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 4 LEADER]: Stepping down as leader of term 4
I20240502 01:54:48.995465 24604 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 4 FOLLOWER]: Advancing to term 5
I20240502 01:54:48.995499 24529 raft_consensus.cc:729] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:48.995754 24529 consensus_queue.cc:260] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:48.996126 24529 raft_consensus.cc:3037] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 4 FOLLOWER]: Advancing to term 5
I20240502 01:54:48.997942 24604 raft_consensus.cc:2454] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 5.
I20240502 01:54:48.998291 24418 leader_election.cc:302] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, 733acd5a64dd410f87531ab9bb22e443; no voters:
I20240502 01:54:48.998389 24529 raft_consensus.cc:2454] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 5.
I20240502 01:54:48.998555 24781 raft_consensus.cc:2781] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 5 FOLLOWER]: Leader election won for term 5
I20240502 01:54:48.998708 24781 raft_consensus.cc:686] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 5 LEADER]: Becoming Leader. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:48.998971 24781 consensus_queue.cc:237] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:49.000947 24349 catalog_manager.cc:5484] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 reported cstate change: term changed from 4 to 5, leader changed from c3632444491e435d90d8f4b6301654cb (127.23.192.2) to 479033503eb94a9885866c04b5816950 (127.23.192.1). New cstate: current_term: 5 leader_uuid: "479033503eb94a9885866c04b5816950" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:49.029001 24765 raft_consensus.cc:979] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb: : Instructing follower 479033503eb94a9885866c04b5816950 to start an election
I20240502 01:54:49.029160 24765 raft_consensus.cc:1067] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Signalling peer 479033503eb94a9885866c04b5816950 to start an election
I20240502 01:54:49.029704 24455 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8bbaf2cb89774b03ac4233ef5575f7fe"
dest_uuid: "479033503eb94a9885866c04b5816950"
from {username='slave'} at 127.0.0.1:48360
I20240502 01:54:49.029841 24455 raft_consensus.cc:482] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:54:49.029930 24455 raft_consensus.cc:3037] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:49.031692 24455 raft_consensus.cc:504] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:49.032169 24455 leader_election.cc:288] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 3 election: Requested vote from peers c3632444491e435d90d8f4b6301654cb (127.23.192.2:40977), 733acd5a64dd410f87531ab9bb22e443 (127.23.192.3:39489)
I20240502 01:54:49.032568 24529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bbaf2cb89774b03ac4233ef5575f7fe" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3632444491e435d90d8f4b6301654cb"
I20240502 01:54:49.032569 24604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bbaf2cb89774b03ac4233ef5575f7fe" candidate_uuid: "479033503eb94a9885866c04b5816950" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "733acd5a64dd410f87531ab9bb22e443"
I20240502 01:54:49.032817 24529 raft_consensus.cc:3032] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Stepping down as leader of term 2
I20240502 01:54:49.032841 24604 raft_consensus.cc:3037] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:49.032920 24529 raft_consensus.cc:729] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3632444491e435d90d8f4b6301654cb, State: Running, Role: LEADER
I20240502 01:54:49.033205 24529 consensus_queue.cc:260] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:49.033560 24529 raft_consensus.cc:3037] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:54:49.035622 24604 raft_consensus.cc:2454] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 3.
I20240502 01:54:49.036056 24418 leader_election.cc:302] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 479033503eb94a9885866c04b5816950, 733acd5a64dd410f87531ab9bb22e443; no voters:
I20240502 01:54:49.036109 24529 raft_consensus.cc:2454] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 479033503eb94a9885866c04b5816950 in term 3.
I20240502 01:54:49.036324 24781 raft_consensus.cc:2781] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:54:49.036485 24781 raft_consensus.cc:686] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 3 LEADER]: Becoming Leader. State: Replica: 479033503eb94a9885866c04b5816950, State: Running, Role: LEADER
I20240502 01:54:49.036725 24781 consensus_queue.cc:237] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } }
I20240502 01:54:49.038973 24349 catalog_manager.cc:5484] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 reported cstate change: term changed from 2 to 3, leader changed from c3632444491e435d90d8f4b6301654cb (127.23.192.2) to 479033503eb94a9885866c04b5816950 (127.23.192.1). New cstate: current_term: 3 leader_uuid: "479033503eb94a9885866c04b5816950" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:49.260869 24529 raft_consensus.cc:1261] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Refusing update from remote peer 733acd5a64dd410f87531ab9bb22e443: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:54:49.261373 24753 consensus_queue.cc:1035] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:54:49.265435 24455 raft_consensus.cc:1261] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Refusing update from remote peer 733acd5a64dd410f87531ab9bb22e443: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:54:49.265945 24753 consensus_queue.cc:1035] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:54:49.452172 24529 raft_consensus.cc:1261] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Refusing update from remote peer 479033503eb94a9885866c04b5816950: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:54:49.452687 24781 consensus_queue.cc:1035] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:54:49.456018 24604 raft_consensus.cc:1261] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Refusing update from remote peer 479033503eb94a9885866c04b5816950: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:54:49.456629 24782 consensus_queue.cc:1035] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:54:49.507874 24529 raft_consensus.cc:1261] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 5 FOLLOWER]: Refusing update from remote peer 479033503eb94a9885866c04b5816950: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240502 01:54:49.508328 24782 consensus_queue.cc:1035] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:54:49.511591 24604 raft_consensus.cc:1261] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 5 FOLLOWER]: Refusing update from remote peer 479033503eb94a9885866c04b5816950: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240502 01:54:49.512202 24782 consensus_queue.cc:1035] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:54:49.526279 24455 raft_consensus.cc:1261] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 4 FOLLOWER]: Refusing update from remote peer 733acd5a64dd410f87531ab9bb22e443: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 01:54:49.526732 24789 consensus_queue.cc:1035] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "479033503eb94a9885866c04b5816950" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:54:49.529799 24529 raft_consensus.cc:1261] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 4 FOLLOWER]: Refusing update from remote peer 733acd5a64dd410f87531ab9bb22e443: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 01:54:49.531054 24753 consensus_queue.cc:1035] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:54:49.534329 24529 raft_consensus.cc:1261] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Refusing update from remote peer 479033503eb94a9885866c04b5816950: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:54:49.534746 24782 consensus_queue.cc:1035] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3632444491e435d90d8f4b6301654cb" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:54:49.537950 24604 raft_consensus.cc:1261] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Refusing update from remote peer 479033503eb94a9885866c04b5816950: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:54:49.538513 24781 consensus_queue.cc:1035] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "733acd5a64dd410f87531ab9bb22e443" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 39489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:54:49.722276 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:49.723850 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:49.724054 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:50.724429 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:50.725957 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:50.726137 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:51.726490 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:51.728075 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:51.728266 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:52.728683 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:52.730352 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:52.730530 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:53.737495 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:53.739051 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:53.739248 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:54.739550 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:54.741125 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:54.741307 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:55.741652 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:55.743206 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:55.743394 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:56.743726 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:56.745450 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:56.745623 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:57.745977 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:54:57.747577 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:54:57.747773 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:54:58.757069 24320 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20240502 01:54:58.757359 24320 tablet_server.cc:178] TabletServer@127.23.192.1:0 shutting down...
I20240502 01:54:58.770206 24320 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 01:54:58.770465 24320 tablet_replica.cc:330] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950: stopping tablet replica
I20240502 01:54:58.770898 24320 raft_consensus.cc:2229] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.771175 24320 raft_consensus.cc:2258] T 83b5855189fd473d8353d300fc707d4d P 479033503eb94a9885866c04b5816950 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.772389 24320 tablet_replica.cc:330] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950: stopping tablet replica
I20240502 01:54:58.772554 24320 raft_consensus.cc:2229] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.772701 24320 raft_consensus.cc:2258] T 37b9e21a819f4ad598db306cc367187a P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.773160 24320 tablet_replica.cc:330] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950: stopping tablet replica
I20240502 01:54:58.773299 24320 raft_consensus.cc:2229] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.773447 24320 raft_consensus.cc:2258] T ac3d1baa68bb4ec98e5202968129c974 P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.773838 24320 tablet_replica.cc:330] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950: stopping tablet replica
I20240502 01:54:58.773988 24320 raft_consensus.cc:2229] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 3 LEADER]: Raft consensus shutting down.
I20240502 01:54:58.774259 24320 raft_consensus.cc:2258] T 8bbaf2cb89774b03ac4233ef5575f7fe P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.774677 24320 tablet_replica.cc:330] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950: stopping tablet replica
I20240502 01:54:58.774808 24320 raft_consensus.cc:2229] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.775020 24320 raft_consensus.cc:2258] T 481b1a040e2f495eaac60225b0897684 P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.775431 24320 tablet_replica.cc:330] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950: stopping tablet replica
I20240502 01:54:58.775579 24320 raft_consensus.cc:2229] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.775712 24320 raft_consensus.cc:2258] T 7524737028cb46daa68e14e1240e7a07 P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.776145 24320 tablet_replica.cc:330] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950: stopping tablet replica
I20240502 01:54:58.776273 24320 raft_consensus.cc:2229] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.776414 24320 raft_consensus.cc:2258] T 4ae222544203452aa1402c768b9c0cea P 479033503eb94a9885866c04b5816950 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.776799 24320 tablet_replica.cc:330] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950: stopping tablet replica
I20240502 01:54:58.776938 24320 raft_consensus.cc:2229] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 5 LEADER]: Raft consensus shutting down.
I20240502 01:54:58.777194 24320 raft_consensus.cc:2258] T e22953c0a720422a9b5336ac903786e6 P 479033503eb94a9885866c04b5816950 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.777612 24320 tablet_replica.cc:330] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950: stopping tablet replica
I20240502 01:54:58.777734 24320 raft_consensus.cc:2229] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 3 LEADER]: Raft consensus shutting down.
I20240502 01:54:58.777971 24320 raft_consensus.cc:2258] T 64f8d56b12f8455b892a3c1d88e20c3e P 479033503eb94a9885866c04b5816950 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.794051 24320 tablet_server.cc:194] TabletServer@127.23.192.1:0 shutdown complete.
I20240502 01:54:58.800122 24320 tablet_server.cc:178] TabletServer@127.23.192.2:0 shutting down...
W20240502 01:54:58.805621 24496 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.192.1:37437: connect: Connection refused (error 111)
W20240502 01:54:58.807590 24570 consensus_peers.cc:485] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 -> Peer 479033503eb94a9885866c04b5816950 (127.23.192.1:37437): Couldn't send request to peer 479033503eb94a9885866c04b5816950. Status: Network error: Client connection negotiation failed: client connection to 127.23.192.1:37437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20240502 01:54:58.807953 24496 consensus_peers.cc:485] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb -> Peer 479033503eb94a9885866c04b5816950 (127.23.192.1:37437): Couldn't send request to peer 479033503eb94a9885866c04b5816950. Status: Network error: Client connection negotiation failed: client connection to 127.23.192.1:37437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 01:54:58.810773 24320 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 01:54:58.811041 24320 tablet_replica.cc:330] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb: stopping tablet replica
I20240502 01:54:58.811208 24320 raft_consensus.cc:2229] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 5 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.811372 24320 raft_consensus.cc:2258] T e22953c0a720422a9b5336ac903786e6 P c3632444491e435d90d8f4b6301654cb [term 5 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.811823 24320 tablet_replica.cc:330] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb: stopping tablet replica
I20240502 01:54:58.811991 24320 raft_consensus.cc:2229] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.812131 24320 raft_consensus.cc:2258] T 83b5855189fd473d8353d300fc707d4d P c3632444491e435d90d8f4b6301654cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.812547 24320 tablet_replica.cc:330] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb: stopping tablet replica
I20240502 01:54:58.812685 24320 raft_consensus.cc:2229] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 3 LEADER]: Raft consensus shutting down.
I20240502 01:54:58.812949 24320 raft_consensus.cc:2258] T 481b1a040e2f495eaac60225b0897684 P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.813349 24320 tablet_replica.cc:330] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb: stopping tablet replica
I20240502 01:54:58.813495 24320 raft_consensus.cc:2229] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Raft consensus shutting down.
I20240502 01:54:58.813730 24320 raft_consensus.cc:2258] T 7524737028cb46daa68e14e1240e7a07 P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.814147 24320 tablet_replica.cc:330] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb: stopping tablet replica
I20240502 01:54:58.814277 24320 raft_consensus.cc:2229] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.814424 24320 raft_consensus.cc:2258] T ac3d1baa68bb4ec98e5202968129c974 P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.814814 24320 tablet_replica.cc:330] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb: stopping tablet replica
I20240502 01:54:58.815011 24320 raft_consensus.cc:2229] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.815148 24320 raft_consensus.cc:2258] T 8bbaf2cb89774b03ac4233ef5575f7fe P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.815548 24320 tablet_replica.cc:330] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb: stopping tablet replica
I20240502 01:54:58.815677 24320 raft_consensus.cc:2229] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 1 LEADER]: Raft consensus shutting down.
I20240502 01:54:58.815923 24320 raft_consensus.cc:2258] T 4ae222544203452aa1402c768b9c0cea P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.816313 24320 tablet_replica.cc:330] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb: stopping tablet replica
I20240502 01:54:58.816457 24320 raft_consensus.cc:2229] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.816593 24320 raft_consensus.cc:2258] T 64f8d56b12f8455b892a3c1d88e20c3e P c3632444491e435d90d8f4b6301654cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.817009 24320 tablet_replica.cc:330] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb: stopping tablet replica
I20240502 01:54:58.817133 24320 raft_consensus.cc:2229] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.817277 24320 raft_consensus.cc:2258] T 37b9e21a819f4ad598db306cc367187a P c3632444491e435d90d8f4b6301654cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.833495 24320 tablet_server.cc:194] TabletServer@127.23.192.2:0 shutdown complete.
I20240502 01:54:58.837268 24320 tablet_server.cc:178] TabletServer@127.23.192.3:0 shutting down...
I20240502 01:54:58.845718 24320 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 01:54:58.845943 24320 tablet_replica.cc:330] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443: stopping tablet replica
I20240502 01:54:58.846112 24320 raft_consensus.cc:2229] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.846278 24320 raft_consensus.cc:2258] T 64f8d56b12f8455b892a3c1d88e20c3e P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.846694 24320 tablet_replica.cc:330] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443: stopping tablet replica
I20240502 01:54:58.846884 24320 raft_consensus.cc:2229] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.847023 24320 raft_consensus.cc:2258] T 4ae222544203452aa1402c768b9c0cea P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.847457 24320 tablet_replica.cc:330] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443: stopping tablet replica
I20240502 01:54:58.847589 24320 raft_consensus.cc:2229] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.847741 24320 raft_consensus.cc:2258] T 481b1a040e2f495eaac60225b0897684 P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.848138 24320 tablet_replica.cc:330] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443: stopping tablet replica
I20240502 01:54:58.848284 24320 raft_consensus.cc:2229] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.848418 24320 raft_consensus.cc:2258] T 7524737028cb46daa68e14e1240e7a07 P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.848825 24320 tablet_replica.cc:330] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443: stopping tablet replica
I20240502 01:54:58.848963 24320 raft_consensus.cc:2229] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.849112 24320 raft_consensus.cc:2258] T e22953c0a720422a9b5336ac903786e6 P 733acd5a64dd410f87531ab9bb22e443 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.849501 24320 tablet_replica.cc:330] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443: stopping tablet replica
I20240502 01:54:58.849644 24320 raft_consensus.cc:2229] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 3 LEADER]: Raft consensus shutting down.
I20240502 01:54:58.849874 24320 raft_consensus.cc:2258] T ac3d1baa68bb4ec98e5202968129c974 P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.850286 24320 tablet_replica.cc:330] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443: stopping tablet replica
I20240502 01:54:58.850417 24320 raft_consensus.cc:2229] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:54:58.850567 24320 raft_consensus.cc:2258] T 8bbaf2cb89774b03ac4233ef5575f7fe P 733acd5a64dd410f87531ab9bb22e443 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.850992 24320 tablet_replica.cc:330] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443: stopping tablet replica
I20240502 01:54:58.851140 24320 raft_consensus.cc:2229] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 4 LEADER]: Raft consensus shutting down.
I20240502 01:54:58.851372 24320 raft_consensus.cc:2258] T 83b5855189fd473d8353d300fc707d4d P 733acd5a64dd410f87531ab9bb22e443 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.851768 24320 tablet_replica.cc:330] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443: stopping tablet replica
I20240502 01:54:58.851897 24320 raft_consensus.cc:2229] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 1 LEADER]: Raft consensus shutting down.
I20240502 01:54:58.852137 24320 raft_consensus.cc:2258] T 37b9e21a819f4ad598db306cc367187a P 733acd5a64dd410f87531ab9bb22e443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.866566 24320 tablet_server.cc:194] TabletServer@127.23.192.3:0 shutdown complete.
I20240502 01:54:58.870349 24320 master.cc:537] Master@127.23.192.62:33759 shutting down...
I20240502 01:54:58.877969 24320 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [term 1 LEADER]: Raft consensus shutting down.
I20240502 01:54:58.878154 24320 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:54:58.878266 24320 tablet_replica.cc:330] T 00000000000000000000000000000000 P ced925c84a4b45629436ad60e5585e6e: stopping tablet replica
I20240502 01:54:58.891994 24320 master.cc:552] Master@127.23.192.62:33759 shutdown complete.
479033503eb94a9885866c04b5816950 4
733acd5a64dd410f87531ab9bb22e443 1
c3632444491e435d90d8f4b6301654cb 4
479033503eb94a9885866c04b5816950 3
733acd5a64dd410f87531ab9bb22e443 3
c3632444491e435d90d8f4b6301654cb 3
479033503eb94a9885866c04b5816950 0
733acd5a64dd410f87531ab9bb22e443 1
c3632444491e435d90d8f4b6301654cb 8
479033503eb94a9885866c04b5816950 3
733acd5a64dd410f87531ab9bb22e443 3
c3632444491e435d90d8f4b6301654cb 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (27329 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20240502 01:54:58.908082 24320 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.192.62:34497
I20240502 01:54:58.908540 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:54:58.911068 24808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:58.911427 24809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:58.911867 24811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:54:58.912305 24320 server_base.cc:1034] running on GCE node
I20240502 01:54:58.912576 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:54:58.912639 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:54:58.912707 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614898912676 us; error 0 us; skew 500 ppm
I20240502 01:54:58.912854 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:54:58.913990 24320 webserver.cc:460] Webserver started at http://127.23.192.62:42241/ using document root <none> and password file <none>
I20240502 01:54:58.914199 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:54:58.914286 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:54:58.914414 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:54:58.915071 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/master-0-root/instance:
uuid: "8ae06c74728d4e58a82b3b0a49332d27"
format_stamp: "Formatted at 2024-05-02 01:54:58 on dist-test-slave-kdrn"
I20240502 01:54:58.917330 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:54:58.918840 24816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:58.919202 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 01:54:58.919301 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/master-0-root
uuid: "8ae06c74728d4e58a82b3b0a49332d27"
format_stamp: "Formatted at 2024-05-02 01:54:58 on dist-test-slave-kdrn"
I20240502 01:54:58.919412 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:54:58.925920 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:54:58.926389 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:54:58.940183 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.62:34497
I20240502 01:54:58.940223 24869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.62:34497 every 8 connection(s)
I20240502 01:54:58.941426 24870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:58.946273 24870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27: Bootstrap starting.
I20240502 01:54:58.947520 24870 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:58.948957 24870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27: No bootstrap required, opened a new log
I20240502 01:54:58.949518 24870 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae06c74728d4e58a82b3b0a49332d27" member_type: VOTER }
I20240502 01:54:58.949656 24870 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:58.949744 24870 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae06c74728d4e58a82b3b0a49332d27, State: Initialized, Role: FOLLOWER
I20240502 01:54:58.950138 24870 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae06c74728d4e58a82b3b0a49332d27" member_type: VOTER }
I20240502 01:54:58.950341 24873 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:58.950465 24873 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae06c74728d4e58a82b3b0a49332d27" member_type: VOTER }
I20240502 01:54:58.950313 24870 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:54:58.950708 24873 leader_election.cc:302] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ae06c74728d4e58a82b3b0a49332d27; no voters:
I20240502 01:54:58.950757 24870 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:54:58.950886 24870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:58.951196 24873 leader_election.cc:288] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20240502 01:54:58.952595 24870 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae06c74728d4e58a82b3b0a49332d27" member_type: VOTER }
I20240502 01:54:58.952806 24870 leader_election.cc:302] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ae06c74728d4e58a82b3b0a49332d27; no voters:
I20240502 01:54:58.952852 24874 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20240502 01:54:58.952988 24870 leader_election.cc:288] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:54:58.953101 24873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:58.953557 24873 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 1 LEADER]: Becoming Leader. State: Replica: 8ae06c74728d4e58a82b3b0a49332d27, State: Running, Role: LEADER
I20240502 01:54:58.953842 24873 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae06c74728d4e58a82b3b0a49332d27" member_type: VOTER }
I20240502 01:54:58.953933 24870 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:54:58.954882 24874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ae06c74728d4e58a82b3b0a49332d27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae06c74728d4e58a82b3b0a49332d27" member_type: VOTER } }
I20240502 01:54:58.955164 24874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [sys.catalog]: This master's current role is: LEADER
I20240502 01:54:58.954981 24875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ae06c74728d4e58a82b3b0a49332d27. Latest consensus state: current_term: 1 leader_uuid: "8ae06c74728d4e58a82b3b0a49332d27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae06c74728d4e58a82b3b0a49332d27" member_type: VOTER } }
I20240502 01:54:58.955468 24875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [sys.catalog]: This master's current role is: LEADER
I20240502 01:54:58.959770 24879 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:54:58.961591 24879 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:54:58.962946 24320 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240502 01:54:58.964776 24879 catalog_manager.cc:1347] Generated new cluster ID: fa0c6b79bed04ec4bb66a85765b5edd4
I20240502 01:54:58.964850 24879 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:54:58.981669 24879 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:54:58.982373 24879 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:54:58.996873 24879 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27: Generated new TSK 0
I20240502 01:54:58.997069 24879 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:54:59.027665 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:54:59.030369 24892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:59.030745 24893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:59.031169 24895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:54:59.031459 24320 server_base.cc:1034] running on GCE node
I20240502 01:54:59.031735 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:54:59.031810 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:54:59.031875 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614899031859 us; error 0 us; skew 500 ppm
I20240502 01:54:59.032042 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:54:59.033182 24320 webserver.cc:460] Webserver started at http://127.23.192.1:39037/ using document root <none> and password file <none>
I20240502 01:54:59.033424 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:54:59.033501 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:54:59.033648 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:54:59.034256 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-0-root/instance:
uuid: "3923e9b1aec34a0b82a751bc07538108"
format_stamp: "Formatted at 2024-05-02 01:54:59 on dist-test-slave-kdrn"
I20240502 01:54:59.036736 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:54:59.038264 24900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:59.038622 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 01:54:59.038735 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-0-root
uuid: "3923e9b1aec34a0b82a751bc07538108"
format_stamp: "Formatted at 2024-05-02 01:54:59 on dist-test-slave-kdrn"
I20240502 01:54:59.038851 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:54:59.046128 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:54:59.046617 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:54:59.047174 24320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:54:59.047989 24320 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:54:59.048074 24320 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:59.048169 24320 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:54:59.048241 24320 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:59.062391 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.1:43575
I20240502 01:54:59.062433 24963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.1:43575 every 8 connection(s)
I20240502 01:54:59.063956 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:54:59.066959 24968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:59.067322 24969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:59.067966 24971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:54:59.068426 24320 server_base.cc:1034] running on GCE node
I20240502 01:54:59.068732 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:54:59.068812 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:54:59.068884 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614899068850 us; error 0 us; skew 500 ppm
I20240502 01:54:59.069052 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:54:59.070405 24320 webserver.cc:460] Webserver started at http://127.23.192.2:32867/ using document root <none> and password file <none>
I20240502 01:54:59.070641 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:54:59.070751 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:54:59.070909 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:54:59.071502 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-1-root/instance:
uuid: "4d14d479dc4c4eb495fc26693b93fe47"
format_stamp: "Formatted at 2024-05-02 01:54:59 on dist-test-slave-kdrn"
I20240502 01:54:59.071751 24964 heartbeater.cc:347] Connected to a master server at 127.23.192.62:34497
I20240502 01:54:59.071880 24964 heartbeater.cc:464] Registering TS with master...
I20240502 01:54:59.072274 24964 heartbeater.cc:511] Master 127.23.192.62:34497 requested a full tablet report, sending...
I20240502 01:54:59.073179 24833 ts_manager.cc:194] Registered new tserver with Master: 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575)
I20240502 01:54:59.074110 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240502 01:54:59.074605 24833 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36686
I20240502 01:54:59.075968 24976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:59.076274 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240502 01:54:59.076375 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-1-root
uuid: "4d14d479dc4c4eb495fc26693b93fe47"
format_stamp: "Formatted at 2024-05-02 01:54:59 on dist-test-slave-kdrn"
I20240502 01:54:59.076499 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:54:59.086162 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:54:59.086675 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:54:59.087237 24320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:54:59.088004 24320 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:54:59.088073 24320 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:59.088178 24320 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:54:59.088232 24320 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:59.101522 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.2:35659
I20240502 01:54:59.101562 25038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.2:35659 every 8 connection(s)
I20240502 01:54:59.103022 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:54:59.106801 25042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:59.107183 25043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:54:59.107956 25045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:54:59.108783 24320 server_base.cc:1034] running on GCE node
I20240502 01:54:59.109055 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:54:59.109143 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:54:59.109211 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614899109190 us; error 0 us; skew 500 ppm
I20240502 01:54:59.109380 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:54:59.110173 25039 heartbeater.cc:347] Connected to a master server at 127.23.192.62:34497
I20240502 01:54:59.110311 25039 heartbeater.cc:464] Registering TS with master...
I20240502 01:54:59.110726 24320 webserver.cc:460] Webserver started at http://127.23.192.3:37929/ using document root <none> and password file <none>
I20240502 01:54:59.110778 25039 heartbeater.cc:511] Master 127.23.192.62:34497 requested a full tablet report, sending...
I20240502 01:54:59.111101 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:54:59.111295 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:54:59.111470 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:54:59.111716 24833 ts_manager.cc:194] Registered new tserver with Master: 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659)
I20240502 01:54:59.112071 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-2-root/instance:
uuid: "bf2089c824504bfa852e91a4d4589a57"
format_stamp: "Formatted at 2024-05-02 01:54:59 on dist-test-slave-kdrn"
I20240502 01:54:59.112419 24833 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36698
I20240502 01:54:59.114689 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:54:59.116253 25050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:59.116596 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 01:54:59.116691 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-2-root
uuid: "bf2089c824504bfa852e91a4d4589a57"
format_stamp: "Formatted at 2024-05-02 01:54:59 on dist-test-slave-kdrn"
I20240502 01:54:59.116782 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714614871514479-24320-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:54:59.127709 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:54:59.128159 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:54:59.128684 24320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:54:59.129417 24320 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:54:59.129489 24320 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:59.129556 24320 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:54:59.129608 24320 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:54:59.144513 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.3:32901
I20240502 01:54:59.144562 25113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.3:32901 every 8 connection(s)
I20240502 01:54:59.150949 25114 heartbeater.cc:347] Connected to a master server at 127.23.192.62:34497
I20240502 01:54:59.151073 25114 heartbeater.cc:464] Registering TS with master...
I20240502 01:54:59.151445 25114 heartbeater.cc:511] Master 127.23.192.62:34497 requested a full tablet report, sending...
I20240502 01:54:59.152208 24833 ts_manager.cc:194] Registered new tserver with Master: bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.152858 24833 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36706
I20240502 01:54:59.153287 24320 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.007897023s
I20240502 01:54:59.154285 24320 test_util.cc:268] Using random seed: -469918371
I20240502 01:54:59.165468 24833 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36714:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240502 01:54:59.166458 24833 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240502 01:54:59.188164 25002 tablet_service.cc:1467] Processing CreateTablet for tablet dab06fdd748c4fef8c8050407ed3628c (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240502 01:54:59.188755 25002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab06fdd748c4fef8c8050407ed3628c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.189132 25004 tablet_service.cc:1467] Processing CreateTablet for tablet 941c5a2c0f1148e1b91600c3b3c75b60 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240502 01:54:59.189605 25004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 941c5a2c0f1148e1b91600c3b3c75b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.195286 25003 tablet_service.cc:1467] Processing CreateTablet for tablet e16fdce22f33489ca383343f0b66da1b (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240502 01:54:59.195780 25003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e16fdce22f33489ca383343f0b66da1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.196062 24928 tablet_service.cc:1467] Processing CreateTablet for tablet 941c5a2c0f1148e1b91600c3b3c75b60 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240502 01:54:59.196537 24928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 941c5a2c0f1148e1b91600c3b3c75b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.197121 25078 tablet_service.cc:1467] Processing CreateTablet for tablet 941c5a2c0f1148e1b91600c3b3c75b60 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240502 01:54:59.197263 24927 tablet_service.cc:1467] Processing CreateTablet for tablet e16fdce22f33489ca383343f0b66da1b (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240502 01:54:59.197686 25078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 941c5a2c0f1148e1b91600c3b3c75b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.197715 24927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e16fdce22f33489ca383343f0b66da1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.199291 25001 tablet_service.cc:1467] Processing CreateTablet for tablet e38d1bc02ed34a75885c87b895b99a16 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240502 01:54:59.199739 25001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e38d1bc02ed34a75885c87b895b99a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.212415 25129 tablet_bootstrap.cc:492] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47: Bootstrap starting.
I20240502 01:54:59.210927 24923 tablet_service.cc:1467] Processing CreateTablet for tablet 859cb0d5e09845b1a59ca9f933a0588b (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240502 01:54:59.211990 24921 tablet_service.cc:1467] Processing CreateTablet for tablet 7b2dfa9a4e814292a3c56a942c7a4ab9 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240502 01:54:59.213335 25000 tablet_service.cc:1467] Processing CreateTablet for tablet 1845a5cb815d4d4bb0ba950ce3923502 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240502 01:54:59.211359 24925 tablet_service.cc:1467] Processing CreateTablet for tablet e38d1bc02ed34a75885c87b895b99a16 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240502 01:54:59.216976 24924 tablet_service.cc:1467] Processing CreateTablet for tablet 1845a5cb815d4d4bb0ba950ce3923502 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240502 01:54:59.217602 24920 tablet_service.cc:1467] Processing CreateTablet for tablet 1ed14d7889ab4d36aa93598e897f0b5d (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240502 01:54:59.216879 24919 tablet_service.cc:1467] Processing CreateTablet for tablet b1b7aca14d2e4932bca0bd37af862620 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240502 01:54:59.219357 24923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 859cb0d5e09845b1a59ca9f933a0588b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.219789 25000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1845a5cb815d4d4bb0ba950ce3923502. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.220813 24999 tablet_service.cc:1467] Processing CreateTablet for tablet 859cb0d5e09845b1a59ca9f933a0588b (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240502 01:54:59.222972 24921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b2dfa9a4e814292a3c56a942c7a4ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.221814 24998 tablet_service.cc:1467] Processing CreateTablet for tablet 5b60a3bbfb2947aabeb73ef4cfd82165 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240502 01:54:59.221109 24922 tablet_service.cc:1467] Processing CreateTablet for tablet 5b60a3bbfb2947aabeb73ef4cfd82165 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240502 01:54:59.222010 24926 tablet_service.cc:1467] Processing CreateTablet for tablet dab06fdd748c4fef8c8050407ed3628c (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240502 01:54:59.228780 24920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ed14d7889ab4d36aa93598e897f0b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.229128 24924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1845a5cb815d4d4bb0ba950ce3923502. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.229585 24919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1b7aca14d2e4932bca0bd37af862620. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.230006 24925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e38d1bc02ed34a75885c87b895b99a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.230430 25129 tablet_bootstrap.cc:654] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.221874 24995 tablet_service.cc:1467] Processing CreateTablet for tablet b1b7aca14d2e4932bca0bd37af862620 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240502 01:54:59.230885 24999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 859cb0d5e09845b1a59ca9f933a0588b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.221910 24997 tablet_service.cc:1467] Processing CreateTablet for tablet 7b2dfa9a4e814292a3c56a942c7a4ab9 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240502 01:54:59.231249 25131 tablet_bootstrap.cc:492] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108: Bootstrap starting.
I20240502 01:54:59.233640 24998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b60a3bbfb2947aabeb73ef4cfd82165. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.232760 24996 tablet_service.cc:1467] Processing CreateTablet for tablet 1ed14d7889ab4d36aa93598e897f0b5d (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240502 01:54:59.234848 25074 tablet_service.cc:1467] Processing CreateTablet for tablet 1845a5cb815d4d4bb0ba950ce3923502 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240502 01:54:59.234040 25072 tablet_service.cc:1467] Processing CreateTablet for tablet 5b60a3bbfb2947aabeb73ef4cfd82165 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240502 01:54:59.237231 24922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b60a3bbfb2947aabeb73ef4cfd82165. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.238030 24995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1b7aca14d2e4932bca0bd37af862620. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.238245 24996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ed14d7889ab4d36aa93598e897f0b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.235708 25073 tablet_service.cc:1467] Processing CreateTablet for tablet 859cb0d5e09845b1a59ca9f933a0588b (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240502 01:54:59.236263 25071 tablet_service.cc:1467] Processing CreateTablet for tablet 7b2dfa9a4e814292a3c56a942c7a4ab9 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240502 01:54:59.239399 25070 tablet_service.cc:1467] Processing CreateTablet for tablet 1ed14d7889ab4d36aa93598e897f0b5d (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240502 01:54:59.239459 25069 tablet_service.cc:1467] Processing CreateTablet for tablet b1b7aca14d2e4932bca0bd37af862620 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240502 01:54:59.239418 25077 tablet_service.cc:1467] Processing CreateTablet for tablet e16fdce22f33489ca383343f0b66da1b (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240502 01:54:59.240108 24926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab06fdd748c4fef8c8050407ed3628c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.240456 25074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1845a5cb815d4d4bb0ba950ce3923502. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.239485 25076 tablet_service.cc:1467] Processing CreateTablet for tablet dab06fdd748c4fef8c8050407ed3628c (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240502 01:54:59.241350 24997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b2dfa9a4e814292a3c56a942c7a4ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.243923 25072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b60a3bbfb2947aabeb73ef4cfd82165. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.240849 25075 tablet_service.cc:1467] Processing CreateTablet for tablet e38d1bc02ed34a75885c87b895b99a16 (DEFAULT_TABLE table=test-workload [id=b755bc2b66cb404f827a5c3b18b094de]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240502 01:54:59.244132 25069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1b7aca14d2e4932bca0bd37af862620. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.247473 25132 tablet_bootstrap.cc:492] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57: Bootstrap starting.
I20240502 01:54:59.251029 25073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 859cb0d5e09845b1a59ca9f933a0588b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.261044 25077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e16fdce22f33489ca383343f0b66da1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.268301 25076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab06fdd748c4fef8c8050407ed3628c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.271955 25070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ed14d7889ab4d36aa93598e897f0b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.272570 25075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e38d1bc02ed34a75885c87b895b99a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.272775 25071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b2dfa9a4e814292a3c56a942c7a4ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:54:59.290057 25129 tablet_bootstrap.cc:492] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47: No bootstrap required, opened a new log
I20240502 01:54:59.291566 25131 tablet_bootstrap.cc:654] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.291695 25132 tablet_bootstrap.cc:654] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.292253 25129 ts_tablet_manager.cc:1367] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47: Time spent bootstrapping tablet: real 0.078s user 0.015s sys 0.010s
I20240502 01:54:59.308012 25129 raft_consensus.cc:348] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.311432 25129 raft_consensus.cc:374] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.317518 25129 raft_consensus.cc:729] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.320139 25129 consensus_queue.cc:260] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.327523 25129 ts_tablet_manager.cc:1398] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47: Time spent starting tablet: real 0.031s user 0.002s sys 0.001s
I20240502 01:54:59.327826 25039 heartbeater.cc:503] Master 127.23.192.62:34497 was elected leader, sending a full tablet report...
I20240502 01:54:59.328836 25129 tablet_bootstrap.cc:492] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47: Bootstrap starting.
I20240502 01:54:59.329114 25132 tablet_bootstrap.cc:492] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57: No bootstrap required, opened a new log
I20240502 01:54:59.329506 25132 ts_tablet_manager.cc:1367] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57: Time spent bootstrapping tablet: real 0.091s user 0.000s sys 0.015s
I20240502 01:54:59.330089 25131 tablet_bootstrap.cc:492] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108: No bootstrap required, opened a new log
I20240502 01:54:59.330237 25131 ts_tablet_manager.cc:1367] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108: Time spent bootstrapping tablet: real 0.109s user 0.004s sys 0.010s
I20240502 01:54:59.330297 25132 raft_consensus.cc:348] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:54:59.330510 25132 raft_consensus.cc:374] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.330605 25132 raft_consensus.cc:729] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.330860 25132 consensus_queue.cc:260] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:54:59.331125 25129 tablet_bootstrap.cc:654] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.331069 25131 raft_consensus.cc:348] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:54:59.331277 25131 raft_consensus.cc:374] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.331379 25131 raft_consensus.cc:729] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.331630 25131 consensus_queue.cc:260] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:54:59.336905 25132 ts_tablet_manager.cc:1398] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57: Time spent starting tablet: real 0.007s user 0.000s sys 0.007s
I20240502 01:54:59.337263 25131 ts_tablet_manager.cc:1398] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20240502 01:54:59.337508 24964 heartbeater.cc:503] Master 127.23.192.62:34497 was elected leader, sending a full tablet report...
I20240502 01:54:59.337589 25131 tablet_bootstrap.cc:492] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108: Bootstrap starting.
I20240502 01:54:59.337757 25114 heartbeater.cc:503] Master 127.23.192.62:34497 was elected leader, sending a full tablet report...
I20240502 01:54:59.338073 25129 tablet_bootstrap.cc:492] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47: No bootstrap required, opened a new log
I20240502 01:54:59.338233 25129 ts_tablet_manager.cc:1367] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20240502 01:54:59.338963 25132 tablet_bootstrap.cc:492] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57: Bootstrap starting.
I20240502 01:54:59.339308 25131 tablet_bootstrap.cc:654] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.339231 25129 raft_consensus.cc:348] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:54:59.339461 25129 raft_consensus.cc:374] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.339601 25129 raft_consensus.cc:729] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.339967 25129 consensus_queue.cc:260] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:54:59.340683 25129 ts_tablet_manager.cc:1398] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:54:59.341081 25129 tablet_bootstrap.cc:492] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47: Bootstrap starting.
I20240502 01:54:59.341426 25132 tablet_bootstrap.cc:654] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.343322 25129 tablet_bootstrap.cc:654] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.348505 25131 tablet_bootstrap.cc:492] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108: No bootstrap required, opened a new log
I20240502 01:54:59.348678 25131 ts_tablet_manager.cc:1367] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20240502 01:54:59.349498 25129 tablet_bootstrap.cc:492] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47: No bootstrap required, opened a new log
I20240502 01:54:59.349503 25132 tablet_bootstrap.cc:492] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57: No bootstrap required, opened a new log
I20240502 01:54:59.349462 25131 raft_consensus.cc:348] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.349656 25129 ts_tablet_manager.cc:1367] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20240502 01:54:59.349718 25131 raft_consensus.cc:374] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.349748 25132 ts_tablet_manager.cc:1367] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20240502 01:54:59.349817 25131 raft_consensus.cc:729] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.350103 25131 consensus_queue.cc:260] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.350472 25129 raft_consensus.cc:348] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.350529 25132 raft_consensus.cc:348] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.350658 25131 ts_tablet_manager.cc:1398] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:54:59.350682 25129 raft_consensus.cc:374] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.350756 25132 raft_consensus.cc:374] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.350780 25129 raft_consensus.cc:729] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.350867 25132 raft_consensus.cc:729] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.350986 25131 tablet_bootstrap.cc:492] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108: Bootstrap starting.
I20240502 01:54:59.351045 25129 consensus_queue.cc:260] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.351145 25132 consensus_queue.cc:260] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.351675 25132 ts_tablet_manager.cc:1398] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:54:59.352157 25129 ts_tablet_manager.cc:1398] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:54:59.352418 25129 tablet_bootstrap.cc:492] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47: Bootstrap starting.
I20240502 01:54:59.352546 25131 tablet_bootstrap.cc:654] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.354226 25129 tablet_bootstrap.cc:654] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.354732 25132 tablet_bootstrap.cc:492] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57: Bootstrap starting.
I20240502 01:54:59.356256 25132 tablet_bootstrap.cc:654] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.360606 25131 tablet_bootstrap.cc:492] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108: No bootstrap required, opened a new log
I20240502 01:54:59.360766 25131 ts_tablet_manager.cc:1367] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20240502 01:54:59.361112 25129 tablet_bootstrap.cc:492] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47: No bootstrap required, opened a new log
I20240502 01:54:59.361330 25129 ts_tablet_manager.cc:1367] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20240502 01:54:59.361395 25131 raft_consensus.cc:348] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.361541 25131 raft_consensus.cc:374] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.361673 25131 raft_consensus.cc:729] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.361891 25131 consensus_queue.cc:260] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.362314 25131 ts_tablet_manager.cc:1398] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:54:59.362332 25129 raft_consensus.cc:348] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.362608 25131 tablet_bootstrap.cc:492] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108: Bootstrap starting.
I20240502 01:54:59.362707 25129 raft_consensus.cc:374] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.362857 25129 raft_consensus.cc:729] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.363210 25129 consensus_queue.cc:260] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.363806 25129 ts_tablet_manager.cc:1398] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:54:59.364166 25129 tablet_bootstrap.cc:492] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47: Bootstrap starting.
I20240502 01:54:59.364192 25132 tablet_bootstrap.cc:492] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57: No bootstrap required, opened a new log
I20240502 01:54:59.364418 25132 ts_tablet_manager.cc:1367] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20240502 01:54:59.365175 25132 raft_consensus.cc:348] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.365300 25131 tablet_bootstrap.cc:654] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.365401 25132 raft_consensus.cc:374] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.365512 25132 raft_consensus.cc:729] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.365810 25132 consensus_queue.cc:260] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.366215 25129 tablet_bootstrap.cc:654] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.367161 25132 ts_tablet_manager.cc:1398] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:54:59.367470 25132 tablet_bootstrap.cc:492] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57: Bootstrap starting.
I20240502 01:54:59.369115 25132 tablet_bootstrap.cc:654] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.373785 25131 tablet_bootstrap.cc:492] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108: No bootstrap required, opened a new log
I20240502 01:54:59.373953 25131 ts_tablet_manager.cc:1367] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20240502 01:54:59.373973 25132 tablet_bootstrap.cc:492] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57: No bootstrap required, opened a new log
I20240502 01:54:59.374126 25132 ts_tablet_manager.cc:1367] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.006s
I20240502 01:54:59.374500 25129 tablet_bootstrap.cc:492] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47: No bootstrap required, opened a new log
I20240502 01:54:59.374624 25132 raft_consensus.cc:348] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.374660 25131 raft_consensus.cc:348] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.374694 25129 ts_tablet_manager.cc:1367] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20240502 01:54:59.374815 25132 raft_consensus.cc:374] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.374899 25131 raft_consensus.cc:374] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.374948 25132 raft_consensus.cc:729] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.375001 25131 raft_consensus.cc:729] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.375283 25131 consensus_queue.cc:260] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.375313 25132 consensus_queue.cc:260] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.375602 25129 raft_consensus.cc:348] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.375789 25129 raft_consensus.cc:374] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.375823 25131 ts_tablet_manager.cc:1398] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:54:59.376245 25131 tablet_bootstrap.cc:492] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108: Bootstrap starting.
I20240502 01:54:59.376209 25129 raft_consensus.cc:729] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.376514 25129 consensus_queue.cc:260] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.377177 25129 ts_tablet_manager.cc:1398] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:54:59.377722 25129 tablet_bootstrap.cc:492] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47: Bootstrap starting.
I20240502 01:54:59.378022 25132 ts_tablet_manager.cc:1398] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:54:59.379419 25129 tablet_bootstrap.cc:654] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.380357 25131 tablet_bootstrap.cc:654] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.380367 25132 tablet_bootstrap.cc:492] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57: Bootstrap starting.
I20240502 01:54:59.381999 25132 tablet_bootstrap.cc:654] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.383153 25131 tablet_bootstrap.cc:492] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108: No bootstrap required, opened a new log
I20240502 01:54:59.383190 25129 tablet_bootstrap.cc:492] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47: No bootstrap required, opened a new log
I20240502 01:54:59.383311 25131 ts_tablet_manager.cc:1367] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s
I20240502 01:54:59.383337 25129 ts_tablet_manager.cc:1367] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240502 01:54:59.383813 25132 tablet_bootstrap.cc:492] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57: No bootstrap required, opened a new log
I20240502 01:54:59.383951 25132 ts_tablet_manager.cc:1367] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20240502 01:54:59.383978 25129 raft_consensus.cc:348] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.384189 25129 raft_consensus.cc:374] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.384140 25131 raft_consensus.cc:348] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.384290 25129 raft_consensus.cc:729] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.384342 25131 raft_consensus.cc:374] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.384445 25131 raft_consensus.cc:729] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.384604 25129 consensus_queue.cc:260] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.384716 25131 consensus_queue.cc:260] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.384760 25132 raft_consensus.cc:348] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.384956 25132 raft_consensus.cc:374] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.385066 25132 raft_consensus.cc:729] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.385102 25129 ts_tablet_manager.cc:1398] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:54:59.385396 25129 tablet_bootstrap.cc:492] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47: Bootstrap starting.
I20240502 01:54:59.385279 25132 consensus_queue.cc:260] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.385807 25132 ts_tablet_manager.cc:1398] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:54:59.386099 25132 tablet_bootstrap.cc:492] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57: Bootstrap starting.
I20240502 01:54:59.386977 25129 tablet_bootstrap.cc:654] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.387449 25131 ts_tablet_manager.cc:1398] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:54:59.387759 25132 tablet_bootstrap.cc:654] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.388417 25131 tablet_bootstrap.cc:492] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108: Bootstrap starting.
I20240502 01:54:59.390028 25131 tablet_bootstrap.cc:654] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.393915 25129 tablet_bootstrap.cc:492] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47: No bootstrap required, opened a new log
I20240502 01:54:59.394078 25129 ts_tablet_manager.cc:1367] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20240502 01:54:59.394270 25132 tablet_bootstrap.cc:492] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57: No bootstrap required, opened a new log
I20240502 01:54:59.394459 25132 ts_tablet_manager.cc:1367] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.004s
I20240502 01:54:59.394817 25129 raft_consensus.cc:348] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.394942 25131 tablet_bootstrap.cc:492] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108: No bootstrap required, opened a new log
I20240502 01:54:59.395007 25129 raft_consensus.cc:374] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.395119 25131 ts_tablet_manager.cc:1367] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20240502 01:54:59.395150 25129 raft_consensus.cc:729] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.395180 25132 raft_consensus.cc:348] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.395390 25132 raft_consensus.cc:374] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.395540 25132 raft_consensus.cc:729] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.395388 25129 consensus_queue.cc:260] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.395803 25132 consensus_queue.cc:260] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.395882 25131 raft_consensus.cc:348] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.396052 25131 raft_consensus.cc:374] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.396155 25131 raft_consensus.cc:729] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.396344 25132 ts_tablet_manager.cc:1398] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:54:59.396436 25131 consensus_queue.cc:260] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.396620 25132 tablet_bootstrap.cc:492] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57: Bootstrap starting.
I20240502 01:54:59.397068 25129 ts_tablet_manager.cc:1398] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:54:59.397364 25129 tablet_bootstrap.cc:492] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47: Bootstrap starting.
I20240502 01:54:59.398207 25132 tablet_bootstrap.cc:654] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.399024 25129 tablet_bootstrap.cc:654] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.399140 25131 ts_tablet_manager.cc:1398] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:54:59.399710 25131 tablet_bootstrap.cc:492] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108: Bootstrap starting.
I20240502 01:54:59.402987 25132 tablet_bootstrap.cc:492] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57: No bootstrap required, opened a new log
I20240502 01:54:59.403159 25132 ts_tablet_manager.cc:1367] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20240502 01:54:59.403163 25131 tablet_bootstrap.cc:654] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.403993 25132 raft_consensus.cc:348] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.404210 25132 raft_consensus.cc:374] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.404327 25132 raft_consensus.cc:729] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.404554 25129 tablet_bootstrap.cc:492] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47: No bootstrap required, opened a new log
I20240502 01:54:59.404543 25132 consensus_queue.cc:260] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.404760 25129 ts_tablet_manager.cc:1367] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20240502 01:54:59.405056 25132 ts_tablet_manager.cc:1398] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 01:54:59.405361 25132 tablet_bootstrap.cc:492] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57: Bootstrap starting.
I20240502 01:54:59.405506 25131 tablet_bootstrap.cc:492] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108: No bootstrap required, opened a new log
I20240502 01:54:59.405570 25129 raft_consensus.cc:348] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.405694 25131 ts_tablet_manager.cc:1367] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240502 01:54:59.405802 25129 raft_consensus.cc:374] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.405900 25129 raft_consensus.cc:729] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.406222 25129 consensus_queue.cc:260] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.406723 25131 raft_consensus.cc:348] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.406946 25132 tablet_bootstrap.cc:654] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.406857 25129 ts_tablet_manager.cc:1398] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:54:59.407030 25131 raft_consensus.cc:374] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.407229 25131 raft_consensus.cc:729] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.407758 25131 consensus_queue.cc:260] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.408135 25129 tablet_bootstrap.cc:492] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47: Bootstrap starting.
I20240502 01:54:59.408452 25131 ts_tablet_manager.cc:1398] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:54:59.408751 25131 tablet_bootstrap.cc:492] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108: Bootstrap starting.
I20240502 01:54:59.409703 25129 tablet_bootstrap.cc:654] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.410365 25131 tablet_bootstrap.cc:654] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.411492 25137 raft_consensus.cc:482] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.411695 25137 raft_consensus.cc:504] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:54:59.413019 25129 tablet_bootstrap.cc:492] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47: No bootstrap required, opened a new log
I20240502 01:54:59.413203 25129 ts_tablet_manager.cc:1367] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20240502 01:54:59.415555 25137 leader_election.cc:288] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575)
I20240502 01:54:59.416704 25129 raft_consensus.cc:348] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.417742 25136 raft_consensus.cc:482] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.418583 25129 raft_consensus.cc:374] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.418953 25136 raft_consensus.cc:504] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.419373 25129 raft_consensus.cc:729] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.419803 25129 consensus_queue.cc:260] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.420523 25136 leader_election.cc:288] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.432389 25136 raft_consensus.cc:482] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.434583 25136 raft_consensus.cc:504] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.435173 25136 leader_election.cc:288] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.435477 25136 raft_consensus.cc:482] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.435626 25136 raft_consensus.cc:504] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.436087 25137 raft_consensus.cc:482] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.436316 25132 tablet_bootstrap.cc:492] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57: No bootstrap required, opened a new log
I20240502 01:54:59.436508 25136 leader_election.cc:288] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.436834 25137 raft_consensus.cc:504] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.437186 25132 ts_tablet_manager.cc:1367] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.007s
I20240502 01:54:59.439307 25137 leader_election.cc:288] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659)
I20240502 01:54:59.440876 25138 raft_consensus.cc:482] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.441167 25138 raft_consensus.cc:504] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.443778 25132 raft_consensus.cc:348] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.444046 25138 leader_election.cc:288] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.446558 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "941c5a2c0f1148e1b91600c3b3c75b60" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108" is_pre_election: true
I20240502 01:54:59.447021 24937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b7aca14d2e4932bca0bd37af862620" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108" is_pre_election: true
I20240502 01:54:59.447645 24938 raft_consensus.cc:2454] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 0.
I20240502 01:54:59.448055 25137 raft_consensus.cc:482] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.448199 25137 raft_consensus.cc:504] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.448803 25137 leader_election.cc:288] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659)
I20240502 01:54:59.467947 25132 raft_consensus.cc:374] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.468080 25132 raft_consensus.cc:729] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.468412 25132 consensus_queue.cc:260] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.468976 25132 ts_tablet_manager.cc:1398] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20240502 01:54:59.470013 25132 tablet_bootstrap.cc:492] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57: Bootstrap starting.
I20240502 01:54:59.471983 25132 tablet_bootstrap.cc:654] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.473850 25014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "941c5a2c0f1148e1b91600c3b3c75b60" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47" is_pre_election: true
I20240502 01:54:59.474136 25014 raft_consensus.cc:2454] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 0.
I20240502 01:54:59.474107 25013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b7aca14d2e4932bca0bd37af862620" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47" is_pre_election: true
I20240502 01:54:59.474541 25012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47" is_pre_election: true
I20240502 01:54:59.474870 25012 raft_consensus.cc:2454] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 0.
I20240502 01:54:59.475391 25053 leader_election.cc:302] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d14d479dc4c4eb495fc26693b93fe47, bf2089c824504bfa852e91a4d4589a57; no voters:
W20240502 01:54:59.475685 25053 leader_election.cc:341] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:54:59.475895 25053 leader_election.cc:302] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d14d479dc4c4eb495fc26693b93fe47, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:54:59.476784 25137 raft_consensus.cc:2781] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:59.476915 25137 raft_consensus.cc:482] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:59.477031 25137 raft_consensus.cc:3037] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.477353 25129 ts_tablet_manager.cc:1398] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47: Time spent starting tablet: real 0.064s user 0.008s sys 0.017s
I20240502 01:54:59.477689 25138 raft_consensus.cc:482] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.478399 25138 raft_consensus.cc:504] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.479014 25138 leader_election.cc:288] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.477766 25132 tablet_bootstrap.cc:492] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57: No bootstrap required, opened a new log
I20240502 01:54:59.479375 25132 ts_tablet_manager.cc:1367] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.002s
I20240502 01:54:59.479079 25129 tablet_bootstrap.cc:492] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47: Bootstrap starting.
I20240502 01:54:59.480219 25132 raft_consensus.cc:348] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.480448 25132 raft_consensus.cc:374] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.480564 25132 raft_consensus.cc:729] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.480823 25132 consensus_queue.cc:260] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.479763 25137 raft_consensus.cc:504] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:54:59.481635 25137 leader_election.cc:288] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 election: Requested vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575)
I20240502 01:54:59.481850 25137 raft_consensus.cc:2781] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:59.481956 25137 raft_consensus.cc:482] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:59.482064 25137 raft_consensus.cc:3037] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.486248 24937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "941c5a2c0f1148e1b91600c3b3c75b60" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:54:59.487102 24937 raft_consensus.cc:3037] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.490204 24937 raft_consensus.cc:2454] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 1.
I20240502 01:54:59.491312 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108" is_pre_election: true
W20240502 01:54:59.493542 25052 leader_election.cc:341] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:54:59.493731 25131 tablet_bootstrap.cc:492] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108: No bootstrap required, opened a new log
I20240502 01:54:59.493678 25052 leader_election.cc:302] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf2089c824504bfa852e91a4d4589a57; no voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47
I20240502 01:54:59.494946 25052 leader_election.cc:302] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:54:59.495829 25129 tablet_bootstrap.cc:654] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.496251 25131 ts_tablet_manager.cc:1367] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108: Time spent bootstrapping tablet: real 0.088s user 0.037s sys 0.038s
I20240502 01:54:59.496631 24937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108" is_pre_election: true
I20240502 01:54:59.496851 24936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b60a3bbfb2947aabeb73ef4cfd82165" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108" is_pre_election: true
I20240502 01:54:59.497089 25131 raft_consensus.cc:348] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.497331 25131 raft_consensus.cc:374] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.497434 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108" is_pre_election: true
I20240502 01:54:59.497664 24938 raft_consensus.cc:2454] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 0.
I20240502 01:54:59.498494 25137 raft_consensus.cc:504] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.499387 25137 leader_election.cc:288] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659)
I20240502 01:54:59.499691 25137 raft_consensus.cc:2726] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:54:59.499934 25137 raft_consensus.cc:2781] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:59.500106 25137 raft_consensus.cc:686] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 1 LEADER]: Becoming Leader. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Running, Role: LEADER
I20240502 01:54:59.500676 25163 raft_consensus.cc:482] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.500946 25163 raft_consensus.cc:504] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.501729 25163 leader_election.cc:288] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.500555 25137 consensus_queue.cc:237] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
W20240502 01:54:59.503158 24978 leader_election.cc:341] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:54:59.503365 24978 leader_election.cc:302] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:54:59.503607 25163 raft_consensus.cc:2781] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:59.503711 25163 raft_consensus.cc:482] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:59.503804 25163 raft_consensus.cc:3037] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.497442 25131 raft_consensus.cc:729] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.506717 25163 raft_consensus.cc:504] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.506749 25131 consensus_queue.cc:260] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.507207 24936 raft_consensus.cc:2454] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 0.
I20240502 01:54:59.507373 25163 leader_election.cc:288] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.508250 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:54:59.508468 25012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47" is_pre_election: true
I20240502 01:54:59.508563 25138 raft_consensus.cc:482] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.508671 25012 raft_consensus.cc:2454] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 0.
I20240502 01:54:59.508694 25138 raft_consensus.cc:504] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.508894 24938 raft_consensus.cc:3037] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.509327 25138 leader_election.cc:288] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.509891 24936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed14d7889ab4d36aa93598e897f0b5d" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108" is_pre_election: true
I20240502 01:54:59.510089 24936 raft_consensus.cc:2454] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 0.
I20240502 01:54:59.511922 24938 raft_consensus.cc:2454] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 1.
I20240502 01:54:59.513232 25131 ts_tablet_manager.cc:1398] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20240502 01:54:59.515717 25131 tablet_bootstrap.cc:492] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108: Bootstrap starting.
I20240502 01:54:59.516884 25012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47" is_pre_election: true
I20240502 01:54:59.517166 25012 raft_consensus.cc:2379] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3923e9b1aec34a0b82a751bc07538108 in current term 1: Already voted for candidate 4d14d479dc4c4eb495fc26693b93fe47 in this term.
I20240502 01:54:59.517730 25012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47" is_pre_election: true
I20240502 01:54:59.517953 25012 raft_consensus.cc:2454] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 0.
I20240502 01:54:59.518250 24978 leader_election.cc:302] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:54:59.518517 25163 raft_consensus.cc:2781] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:59.518617 25163 raft_consensus.cc:482] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:59.518733 25163 raft_consensus.cc:3037] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.519367 25131 tablet_bootstrap.cc:654] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.521827 25163 raft_consensus.cc:504] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.522483 25163 leader_election.cc:288] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.516886 25129 tablet_bootstrap.cc:492] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47: No bootstrap required, opened a new log
I20240502 01:54:59.522785 25129 ts_tablet_manager.cc:1367] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.004s
I20240502 01:54:59.523593 25129 raft_consensus.cc:348] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.523833 25129 raft_consensus.cc:374] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.523927 25129 raft_consensus.cc:729] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.524204 25129 consensus_queue.cc:260] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.524717 25129 ts_tablet_manager.cc:1398] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:54:59.527156 24978 leader_election.cc:302] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:54:59.527482 24978 leader_election.cc:302] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:54:59.527730 25136 raft_consensus.cc:2781] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:59.527844 25136 raft_consensus.cc:482] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:59.527948 25136 raft_consensus.cc:3037] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.530901 25136 raft_consensus.cc:504] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.531533 25136 leader_election.cc:288] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.531733 25136 raft_consensus.cc:2781] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:59.531858 25136 raft_consensus.cc:686] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:54:59.532157 25136 consensus_queue.cc:237] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
W20240502 01:54:59.536042 25053 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.192.2:35659, user_credentials={real_user=slave}} blocked reactor thread for 60144.3us
I20240502 01:54:59.536767 25012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "941c5a2c0f1148e1b91600c3b3c75b60" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:54:59.536970 25012 raft_consensus.cc:3037] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.540095 25012 raft_consensus.cc:2454] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 1.
I20240502 01:54:59.540902 24903 leader_election.cc:302] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:54:59.541209 25138 raft_consensus.cc:2781] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:59.541328 25138 raft_consensus.cc:482] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:59.541426 25138 raft_consensus.cc:3037] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.544260 25138 raft_consensus.cc:504] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.545205 25138 leader_election.cc:288] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 election: Requested vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.545939 24903 leader_election.cc:302] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:54:59.546238 25138 raft_consensus.cc:2781] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:59.546341 25138 raft_consensus.cc:482] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:59.546450 25138 raft_consensus.cc:3037] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.549260 25138 raft_consensus.cc:504] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.550160 25138 leader_election.cc:288] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 election: Requested vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.550841 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b60a3bbfb2947aabeb73ef4cfd82165" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:54:59.551045 24938 raft_consensus.cc:3037] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.554013 24938 raft_consensus.cc:2454] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 1.
I20240502 01:54:59.556582 25012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:54:59.556802 25012 raft_consensus.cc:3037] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.559701 25012 raft_consensus.cc:2454] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 1.
W20240502 01:54:59.560225 25052 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.192.1:43575, user_credentials={real_user=slave}} blocked reactor thread for 65568.3us
W20240502 01:54:59.560530 25052 leader_election.cc:341] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:54:59.560781 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57" is_pre_election: true
I20240502 01:54:59.561055 25089 raft_consensus.cc:2454] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 0.
I20240502 01:54:59.561209 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed14d7889ab4d36aa93598e897f0b5d" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:54:59.561278 24936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:54:59.561411 24938 raft_consensus.cc:3037] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.562117 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57" is_pre_election: true
I20240502 01:54:59.562320 25089 raft_consensus.cc:2454] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 0.
I20240502 01:54:59.562786 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57" is_pre_election: true
I20240502 01:54:59.563006 25089 raft_consensus.cc:2454] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 0.
I20240502 01:54:59.563500 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57" is_pre_election: true
I20240502 01:54:59.563710 25089 raft_consensus.cc:2454] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 0.
I20240502 01:54:59.564605 24938 raft_consensus.cc:2454] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 1.
I20240502 01:54:59.564668 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:54:59.564838 25089 raft_consensus.cc:3037] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.565147 25138 raft_consensus.cc:482] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.565328 25138 raft_consensus.cc:504] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.566290 25138 leader_election.cc:288] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.567420 25088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57" is_pre_election: true
I20240502 01:54:59.567765 25088 raft_consensus.cc:2379] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d14d479dc4c4eb495fc26693b93fe47 in current term 1: Already voted for candidate bf2089c824504bfa852e91a4d4589a57 in this term.
I20240502 01:54:59.567910 25089 raft_consensus.cc:2454] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 1.
I20240502 01:54:59.568256 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b60a3bbfb2947aabeb73ef4cfd82165" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57" is_pre_election: true
I20240502 01:54:59.568372 24978 leader_election.cc:302] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:54:59.568468 25089 raft_consensus.cc:2454] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 0.
I20240502 01:54:59.568684 24978 leader_election.cc:302] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:54:59.568841 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:54:59.569044 25089 raft_consensus.cc:3037] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.569087 25163 raft_consensus.cc:2781] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:59.571950 25089 raft_consensus.cc:2454] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 1.
I20240502 01:54:59.573020 25088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed14d7889ab4d36aa93598e897f0b5d" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57" is_pre_election: true
I20240502 01:54:59.573228 25088 raft_consensus.cc:2454] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 0.
I20240502 01:54:59.573210 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1845a5cb815d4d4bb0ba950ce3923502" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57" is_pre_election: true
I20240502 01:54:59.573596 25089 raft_consensus.cc:2454] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 0.
I20240502 01:54:59.573602 25087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:54:59.573945 25087 raft_consensus.cc:3037] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.574297 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ed14d7889ab4d36aa93598e897f0b5d" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:54:59.574391 25053 leader_election.cc:302] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d14d479dc4c4eb495fc26693b93fe47, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:54:59.574501 25089 raft_consensus.cc:3037] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.574730 25169 raft_consensus.cc:482] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.573655 25088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b60a3bbfb2947aabeb73ef4cfd82165" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:54:59.574925 25169 raft_consensus.cc:504] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.575706 25169 leader_election.cc:288] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659)
I20240502 01:54:59.575922 25169 raft_consensus.cc:2781] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:59.575986 24902 leader_election.cc:302] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57; no voters: 4d14d479dc4c4eb495fc26693b93fe47
I20240502 01:54:59.576174 25169 raft_consensus.cc:686] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 1 LEADER]: Becoming Leader. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Running, Role: LEADER
I20240502 01:54:59.576449 25138 raft_consensus.cc:2741] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20240502 01:54:59.576558 25169 consensus_queue.cc:237] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.577067 25087 raft_consensus.cc:2454] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 1.
I20240502 01:54:59.577097 24902 leader_election.cc:302] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:54:59.577385 25138 raft_consensus.cc:2781] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:59.577468 25088 raft_consensus.cc:3037] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.577836 24902 leader_election.cc:302] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:54:59.580013 25136 raft_consensus.cc:2781] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:59.580127 25088 raft_consensus.cc:2454] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 1.
I20240502 01:54:59.580180 25136 raft_consensus.cc:686] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:54:59.580458 25136 consensus_queue.cc:237] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.581200 25180 raft_consensus.cc:2781] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:59.581357 25180 raft_consensus.cc:686] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Becoming Leader. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:54:59.581712 25180 consensus_queue.cc:237] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.582440 24902 leader_election.cc:302] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:54:59.584502 25089 raft_consensus.cc:2454] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 1.
I20240502 01:54:59.585269 24832 catalog_manager.cc:5484] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf2089c824504bfa852e91a4d4589a57 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "bf2089c824504bfa852e91a4d4589a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:59.590880 25138 raft_consensus.cc:686] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Becoming Leader. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:54:59.591132 25138 consensus_queue.cc:237] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.591835 25012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b60a3bbfb2947aabeb73ef4cfd82165" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47" is_pre_election: true
I20240502 01:54:59.591982 25132 ts_tablet_manager.cc:1398] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57: Time spent starting tablet: real 0.112s user 0.043s sys 0.051s
I20240502 01:54:59.592305 25132 tablet_bootstrap.cc:492] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57: Bootstrap starting.
W20240502 01:54:59.592701 25052 leader_election.cc:341] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:54:59.593454 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b60a3bbfb2947aabeb73ef4cfd82165" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108" is_pre_election: true
I20240502 01:54:59.593693 24938 raft_consensus.cc:2379] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf2089c824504bfa852e91a4d4589a57 in current term 1: Already voted for candidate 4d14d479dc4c4eb495fc26693b93fe47 in this term.
I20240502 01:54:59.594295 25132 tablet_bootstrap.cc:654] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.597225 24832 catalog_manager.cc:5484] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf2089c824504bfa852e91a4d4589a57 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "bf2089c824504bfa852e91a4d4589a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: HEALTHY } } }
I20240502 01:54:59.600405 25163 raft_consensus.cc:686] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:54:59.600718 25163 consensus_queue.cc:237] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.601444 25131 tablet_bootstrap.cc:492] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108: No bootstrap required, opened a new log
I20240502 01:54:59.601673 25131 ts_tablet_manager.cc:1367] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108: Time spent bootstrapping tablet: real 0.086s user 0.033s sys 0.043s
I20240502 01:54:59.602103 25013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:54:59.602311 25013 raft_consensus.cc:3037] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.602700 25131 raft_consensus.cc:348] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.602993 25131 raft_consensus.cc:374] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.603762 25131 raft_consensus.cc:729] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.606230 25013 raft_consensus.cc:2454] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 1.
I20240502 01:54:59.607371 25013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:54:59.607578 25013 raft_consensus.cc:3037] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.608868 24978 leader_election.cc:302] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d14d479dc4c4eb495fc26693b93fe47; no voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57
I20240502 01:54:59.609827 25131 consensus_queue.cc:260] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.610574 25178 raft_consensus.cc:2781] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:59.614984 25178 raft_consensus.cc:482] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:59.616299 25014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1845a5cb815d4d4bb0ba950ce3923502" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47" is_pre_election: true
I20240502 01:54:59.616508 25014 raft_consensus.cc:2454] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 0.
I20240502 01:54:59.616607 25132 tablet_bootstrap.cc:492] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57: No bootstrap required, opened a new log
I20240502 01:54:59.616771 25132 ts_tablet_manager.cc:1367] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57: Time spent bootstrapping tablet: real 0.025s user 0.007s sys 0.006s
I20240502 01:54:59.617024 25053 leader_election.cc:302] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf2089c824504bfa852e91a4d4589a57; no voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47
I20240502 01:54:59.617318 25170 raft_consensus.cc:2726] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:54:59.617440 24832 catalog_manager.cc:5484] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:59.617640 25132 raft_consensus.cc:348] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.617836 25132 raft_consensus.cc:374] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.617923 25132 raft_consensus.cc:729] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.618152 25132 consensus_queue.cc:260] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.618592 25131 ts_tablet_manager.cc:1398] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20240502 01:54:59.618667 25132 ts_tablet_manager.cc:1398] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 01:54:59.618973 25131 tablet_bootstrap.cc:492] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108: Bootstrap starting.
I20240502 01:54:59.618932 25176 raft_consensus.cc:2726] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:54:59.620707 25131 tablet_bootstrap.cc:654] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108: Neither blocks nor log segments found. Creating new log.
I20240502 01:54:59.621124 24830 catalog_manager.cc:5484] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1). New cstate: current_term: 1 leader_uuid: "3923e9b1aec34a0b82a751bc07538108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:59.622934 25013 raft_consensus.cc:2454] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 1.
I20240502 01:54:59.623379 25178 raft_consensus.cc:3037] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.625286 24832 catalog_manager.cc:5484] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:59.625844 24832 catalog_manager.cc:5484] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:59.626219 25178 raft_consensus.cc:504] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.626525 24831 catalog_manager.cc:5484] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1). New cstate: current_term: 1 leader_uuid: "3923e9b1aec34a0b82a751bc07538108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:59.627135 25178 leader_election.cc:288] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 election: Requested vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.627449 25131 tablet_bootstrap.cc:492] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108: No bootstrap required, opened a new log
I20240502 01:54:59.627628 25131 ts_tablet_manager.cc:1367] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20240502 01:54:59.627563 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1845a5cb815d4d4bb0ba950ce3923502" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:54:59.627846 25089 raft_consensus.cc:3037] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.627570 25013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1845a5cb815d4d4bb0ba950ce3923502" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:54:59.628497 25013 raft_consensus.cc:3037] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.628535 25131 raft_consensus.cc:348] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.628755 25131 raft_consensus.cc:374] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:54:59.628846 25131 raft_consensus.cc:729] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Initialized, Role: FOLLOWER
I20240502 01:54:59.629097 25131 consensus_queue.cc:260] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.629654 25131 ts_tablet_manager.cc:1398] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 01:54:59.630573 25089 raft_consensus.cc:2454] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 1.
I20240502 01:54:59.630790 25013 raft_consensus.cc:2454] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 1.
I20240502 01:54:59.631036 24902 leader_election.cc:302] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:54:59.631304 25178 raft_consensus.cc:2781] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:59.631485 25178 raft_consensus.cc:686] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Becoming Leader. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:54:59.631691 25178 consensus_queue.cc:237] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.633935 24831 catalog_manager.cc:5484] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1). New cstate: current_term: 1 leader_uuid: "3923e9b1aec34a0b82a751bc07538108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:59.708379 25176 raft_consensus.cc:482] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.708535 25176 raft_consensus.cc:504] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.709045 25176 leader_election.cc:288] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.709440 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e38d1bc02ed34a75885c87b895b99a16" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108" is_pre_election: true
I20240502 01:54:59.709522 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e38d1bc02ed34a75885c87b895b99a16" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57" is_pre_election: true
I20240502 01:54:59.709625 24938 raft_consensus.cc:2454] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 0.
I20240502 01:54:59.709738 25089 raft_consensus.cc:2454] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 0.
I20240502 01:54:59.710014 24978 leader_election.cc:302] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:54:59.710284 25176 raft_consensus.cc:2781] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:59.710371 25176 raft_consensus.cc:482] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:59.710446 25176 raft_consensus.cc:3037] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.712119 25176 raft_consensus.cc:504] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.712652 25176 leader_election.cc:288] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.713038 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e38d1bc02ed34a75885c87b895b99a16" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:54:59.713079 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e38d1bc02ed34a75885c87b895b99a16" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:54:59.713194 24938 raft_consensus.cc:3037] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.713219 25089 raft_consensus.cc:3037] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.715111 24938 raft_consensus.cc:2454] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 1.
I20240502 01:54:59.715204 25089 raft_consensus.cc:2454] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 1.
I20240502 01:54:59.715456 24978 leader_election.cc:302] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:54:59.715695 25176 raft_consensus.cc:2781] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:59.715858 25176 raft_consensus.cc:686] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:54:59.716105 25176 consensus_queue.cc:237] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.718308 24831 catalog_manager.cc:5484] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:54:59.896062 25178 raft_consensus.cc:482] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.896209 25178 raft_consensus.cc:504] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.896894 25178 leader_election.cc:288] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.897254 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57" is_pre_election: true
I20240502 01:54:59.897255 25013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47" is_pre_election: true
I20240502 01:54:59.897564 25013 raft_consensus.cc:2379] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3923e9b1aec34a0b82a751bc07538108 in current term 1: Already voted for candidate bf2089c824504bfa852e91a4d4589a57 in this term.
I20240502 01:54:59.897889 24903 leader_election.cc:302] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108; no voters: 4d14d479dc4c4eb495fc26693b93fe47, bf2089c824504bfa852e91a4d4589a57
I20240502 01:54:59.898156 25178 raft_consensus.cc:3037] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.899906 25178 raft_consensus.cc:2726] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:54:59.913419 25170 consensus_queue.cc:1035] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:59.917518 25169 consensus_queue.cc:1035] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:59.923462 25176 consensus_queue.cc:1035] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:54:59.927558 25176 consensus_queue.cc:1035] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 01:54:59.962478 24884 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 01:54:59.990734 25176 raft_consensus.cc:482] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:54:59.990895 25176 raft_consensus.cc:504] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.991519 25176 leader_election.cc:288] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.991812 24936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b7aca14d2e4932bca0bd37af862620" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108" is_pre_election: true
I20240502 01:54:59.991923 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b7aca14d2e4932bca0bd37af862620" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57" is_pre_election: true
I20240502 01:54:59.992003 24936 raft_consensus.cc:2454] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 0.
I20240502 01:54:59.992111 25089 raft_consensus.cc:2454] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 0.
I20240502 01:54:59.992378 24978 leader_election.cc:302] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:54:59.992611 25176 raft_consensus.cc:2781] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:54:59.992717 25176 raft_consensus.cc:482] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:54:59.992802 25176 raft_consensus.cc:3037] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.994485 25176 raft_consensus.cc:504] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:54:59.994974 25176 leader_election.cc:288] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:54:59.995306 24936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b7aca14d2e4932bca0bd37af862620" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:54:59.995388 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b7aca14d2e4932bca0bd37af862620" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:54:59.995471 24936 raft_consensus.cc:3037] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.995563 25089 raft_consensus.cc:3037] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:54:59.997352 24936 raft_consensus.cc:2454] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 1.
I20240502 01:54:59.997486 25089 raft_consensus.cc:2454] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 1.
I20240502 01:54:59.997701 24978 leader_election.cc:302] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:54:59.997957 25176 raft_consensus.cc:2781] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:54:59.998080 25176 raft_consensus.cc:686] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Becoming Leader. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:54:59.998325 25176 consensus_queue.cc:237] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.000506 24832 catalog_manager.cc:5484] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:00.004757 25169 consensus_queue.cc:1035] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.008105 25170 consensus_queue.cc:1035] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.045097 25178 consensus_queue.cc:1035] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.048439 25138 consensus_queue.cc:1035] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.068888 25176 consensus_queue.cc:1035] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.072355 25163 consensus_queue.cc:1035] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.077046 25138 consensus_queue.cc:1035] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.080753 25182 consensus_queue.cc:1035] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.101958 25089 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "941c5a2c0f1148e1b91600c3b3c75b60"
dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
mode: GRACEFUL
new_leader_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:60336
I20240502 01:55:00.102137 25089 raft_consensus.cc:595] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 1 LEADER]: Received request to transfer leadership to TS 3923e9b1aec34a0b82a751bc07538108
I20240502 01:55:00.108284 25013 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b"
dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
mode: GRACEFUL
new_leader_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:44822
I20240502 01:55:00.108440 25013 raft_consensus.cc:595] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Received request to transfer leadership to TS 3923e9b1aec34a0b82a751bc07538108
I20240502 01:55:00.110188 25089 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c"
dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
mode: GRACEFUL
new_leader_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:60336
I20240502 01:55:00.110379 25089 raft_consensus.cc:595] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 1 LEADER]: Received request to transfer leadership to TS 3923e9b1aec34a0b82a751bc07538108
I20240502 01:55:00.112133 25013 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e38d1bc02ed34a75885c87b895b99a16"
dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
mode: GRACEFUL
new_leader_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:44822
I20240502 01:55:00.112282 25013 raft_consensus.cc:595] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Received request to transfer leadership to TS 3923e9b1aec34a0b82a751bc07538108
I20240502 01:55:00.119212 24936 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
mode: GRACEFUL
new_leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
from {username='slave'} at 127.0.0.1:43632
I20240502 01:55:00.119362 24936 raft_consensus.cc:595] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Received request to transfer leadership to TS 4d14d479dc4c4eb495fc26693b93fe47
I20240502 01:55:00.121970 24936 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
mode: GRACEFUL
new_leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
from {username='slave'} at 127.0.0.1:43632
I20240502 01:55:00.122113 24936 raft_consensus.cc:595] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Received request to transfer leadership to TS 4d14d479dc4c4eb495fc26693b93fe47
I20240502 01:55:00.124740 25013 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b1b7aca14d2e4932bca0bd37af862620"
dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
mode: GRACEFUL
new_leader_uuid: "bf2089c824504bfa852e91a4d4589a57"
from {username='slave'} at 127.0.0.1:44822
I20240502 01:55:00.124900 25013 raft_consensus.cc:595] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Received request to transfer leadership to TS bf2089c824504bfa852e91a4d4589a57
I20240502 01:55:00.166779 25176 consensus_queue.cc:1035] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.170385 25177 consensus_queue.cc:1035] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.175869 25177 consensus_queue.cc:1035] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.179540 25163 consensus_queue.cc:1035] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.182423 25177 raft_consensus.cc:979] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47: : Instructing follower 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:00.182592 25177 raft_consensus.cc:1067] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Signalling peer 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:00.183244 24936 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e38d1bc02ed34a75885c87b895b99a16"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:43630
I20240502 01:55:00.183421 24936 raft_consensus.cc:482] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:00.183552 24936 raft_consensus.cc:3037] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.185883 24936 raft_consensus.cc:504] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.186448 24936 leader_election.cc:288] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 2 election: Requested vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:55:00.186815 25013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e38d1bc02ed34a75885c87b895b99a16" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:00.186888 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e38d1bc02ed34a75885c87b895b99a16" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:55:00.187055 25013 raft_consensus.cc:3032] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:55:00.187103 25089 raft_consensus.cc:3037] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.187170 25013 raft_consensus.cc:729] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:55:00.187422 25013 consensus_queue.cc:260] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.187721 25013 raft_consensus.cc:3037] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.189075 25089 raft_consensus.cc:2454] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 2.
I20240502 01:55:00.189391 24902 leader_election.cc:302] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:00.189672 25182 raft_consensus.cc:2781] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:55:00.189726 25013 raft_consensus.cc:2454] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 2.
I20240502 01:55:00.189854 25182 raft_consensus.cc:686] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Becoming Leader. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:00.190136 25182 consensus_queue.cc:237] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.191910 24832 catalog_manager.cc:5484] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 reported cstate change: term changed from 1 to 2, leader changed from 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2) to 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1). New cstate: current_term: 2 leader_uuid: "3923e9b1aec34a0b82a751bc07538108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:00.203485 25182 consensus_queue.cc:1035] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.204027 25182 consensus_queue.cc:1035] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.206934 25138 raft_consensus.cc:979] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108: : Instructing follower 4d14d479dc4c4eb495fc26693b93fe47 to start an election
I20240502 01:55:00.207085 25138 raft_consensus.cc:1067] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Signalling peer 4d14d479dc4c4eb495fc26693b93fe47 to start an election
I20240502 01:55:00.207690 25014 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9"
dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
from {username='slave'} at 127.0.0.1:44818
I20240502 01:55:00.209028 25014 raft_consensus.cc:482] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:00.209179 25014 raft_consensus.cc:3037] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.211526 25014 raft_consensus.cc:504] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.212203 25014 leader_election.cc:288] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 2 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:55:00.212550 24936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:55:00.212612 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:55:00.212738 24936 raft_consensus.cc:3032] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:55:00.212793 25089 raft_consensus.cc:3037] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.212839 24936 raft_consensus.cc:729] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:00.213189 24936 consensus_queue.cc:260] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.213614 24936 raft_consensus.cc:3037] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.214941 25089 raft_consensus.cc:2454] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 2.
I20240502 01:55:00.215277 24978 leader_election.cc:302] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d14d479dc4c4eb495fc26693b93fe47, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:00.215559 25177 raft_consensus.cc:2781] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:55:00.215677 25177 raft_consensus.cc:686] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 LEADER]: Becoming Leader. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:55:00.215878 24936 raft_consensus.cc:2454] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 2.
I20240502 01:55:00.215921 25177 consensus_queue.cc:237] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.218010 24831 catalog_manager.cc:5484] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 reported cstate change: term changed from 1 to 2, leader changed from 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1) to 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2). New cstate: current_term: 2 leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:00.390081 25177 raft_consensus.cc:979] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47: : Instructing follower 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:00.390249 25177 raft_consensus.cc:1067] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Signalling peer 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:00.390782 24936 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:43630
I20240502 01:55:00.390986 24936 raft_consensus.cc:482] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:00.391086 24936 raft_consensus.cc:3037] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.392918 24936 raft_consensus.cc:504] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.393422 24936 leader_election.cc:288] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 2 election: Requested vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:55:00.393807 25014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:00.393870 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:55:00.394070 25089 raft_consensus.cc:3037] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.394109 25014 raft_consensus.cc:3032] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:55:00.394191 25014 raft_consensus.cc:729] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:55:00.394454 25014 consensus_queue.cc:260] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.394866 25014 raft_consensus.cc:3037] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.397037 25089 raft_consensus.cc:2454] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 2.
I20240502 01:55:00.397433 24902 leader_election.cc:302] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:00.397509 25014 raft_consensus.cc:2454] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 2.
I20240502 01:55:00.397817 25138 raft_consensus.cc:2781] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:55:00.397964 25138 raft_consensus.cc:686] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Becoming Leader. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:00.398208 25138 consensus_queue.cc:237] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.400234 24831 catalog_manager.cc:5484] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 reported cstate change: term changed from 1 to 2, leader changed from 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2) to 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1). New cstate: current_term: 2 leader_uuid: "3923e9b1aec34a0b82a751bc07538108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:00.404547 25137 raft_consensus.cc:979] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57: : Instructing follower 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:00.404695 25137 raft_consensus.cc:1067] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 1 LEADER]: Signalling peer 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:00.405262 24936 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:43620
I20240502 01:55:00.405398 24936 raft_consensus.cc:482] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:00.405500 24936 raft_consensus.cc:3037] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.407172 24936 raft_consensus.cc:504] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.407699 24936 leader_election.cc:288] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 2 election: Requested vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:55:00.408032 25014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:00.408118 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:55:00.408228 25014 raft_consensus.cc:3037] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.408303 25089 raft_consensus.cc:3032] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:55:00.408402 25089 raft_consensus.cc:729] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Running, Role: LEADER
I20240502 01:55:00.408627 25089 consensus_queue.cc:260] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.408933 25089 raft_consensus.cc:3037] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.410176 25014 raft_consensus.cc:2454] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 2.
I20240502 01:55:00.410498 24903 leader_election.cc:302] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:55:00.410725 25180 raft_consensus.cc:2781] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:55:00.410921 25089 raft_consensus.cc:2454] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 2.
I20240502 01:55:00.410928 25180 raft_consensus.cc:686] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Becoming Leader. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:00.411201 25180 consensus_queue.cc:237] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.412997 24831 catalog_manager.cc:5484] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 reported cstate change: term changed from 1 to 2, leader changed from bf2089c824504bfa852e91a4d4589a57 (127.23.192.3) to 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1). New cstate: current_term: 2 leader_uuid: "3923e9b1aec34a0b82a751bc07538108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:00.425498 25177 consensus_queue.cc:1035] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.429992 25177 consensus_queue.cc:1035] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:00.432436 25136 raft_consensus.cc:979] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47: : Instructing follower bf2089c824504bfa852e91a4d4589a57 to start an election
I20240502 01:55:00.432592 25136 raft_consensus.cc:1067] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Signalling peer bf2089c824504bfa852e91a4d4589a57 to start an election
I20240502 01:55:00.433193 25089 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b1b7aca14d2e4932bca0bd37af862620"
dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
from {username='slave'} at 127.0.0.1:60328
I20240502 01:55:00.433339 25089 raft_consensus.cc:482] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:00.433452 25089 raft_consensus.cc:3037] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.435123 25089 raft_consensus.cc:504] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.435676 25089 leader_election.cc:288] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 2 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659)
I20240502 01:55:00.436087 24936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b7aca14d2e4932bca0bd37af862620" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:55:00.436239 25014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b7aca14d2e4932bca0bd37af862620" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:00.436295 24936 raft_consensus.cc:3037] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.436411 25014 raft_consensus.cc:3032] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:55:00.436517 25014 raft_consensus.cc:729] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:55:00.436764 25014 consensus_queue.cc:260] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.437183 25014 raft_consensus.cc:3037] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.439229 24936 raft_consensus.cc:2454] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 2.
I20240502 01:55:00.439596 25052 leader_election.cc:302] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:00.439774 25014 raft_consensus.cc:2454] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 2.
I20240502 01:55:00.439862 25137 raft_consensus.cc:2781] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:55:00.440052 25137 raft_consensus.cc:686] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 2 LEADER]: Becoming Leader. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Running, Role: LEADER
I20240502 01:55:00.440259 25137 consensus_queue.cc:237] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.441942 24831 catalog_manager.cc:5484] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 reported cstate change: term changed from 1 to 2, leader changed from 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2) to bf2089c824504bfa852e91a4d4589a57 (127.23.192.3). New cstate: current_term: 2 leader_uuid: "bf2089c824504bfa852e91a4d4589a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:00.511969 25170 raft_consensus.cc:979] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57: : Instructing follower 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:00.512151 25170 raft_consensus.cc:1067] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 1 LEADER]: Signalling peer 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:00.512835 24936 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "941c5a2c0f1148e1b91600c3b3c75b60"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:43620
I20240502 01:55:00.513020 24936 raft_consensus.cc:482] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:00.513145 24936 raft_consensus.cc:3037] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.514917 24936 raft_consensus.cc:504] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:55:00.515475 24936 leader_election.cc:288] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 2 election: Requested vote from peers bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901), 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659)
I20240502 01:55:00.515822 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "941c5a2c0f1148e1b91600c3b3c75b60" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:55:00.515894 25014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "941c5a2c0f1148e1b91600c3b3c75b60" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:00.515998 25089 raft_consensus.cc:3032] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:55:00.516078 25089 raft_consensus.cc:729] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Running, Role: LEADER
I20240502 01:55:00.516095 25014 raft_consensus.cc:3037] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.516322 25089 consensus_queue.cc:260] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:55:00.516614 25089 raft_consensus.cc:3037] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.518144 25014 raft_consensus.cc:2454] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 2.
I20240502 01:55:00.518548 24903 leader_election.cc:302] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:55:00.518694 25089 raft_consensus.cc:2454] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 2.
I20240502 01:55:00.518854 25182 raft_consensus.cc:2781] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:55:00.519029 25182 raft_consensus.cc:686] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Becoming Leader. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:00.519299 25182 consensus_queue.cc:237] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:55:00.521188 24831 catalog_manager.cc:5484] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 reported cstate change: term changed from 1 to 2, leader changed from bf2089c824504bfa852e91a4d4589a57 (127.23.192.3) to 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1). New cstate: current_term: 2 leader_uuid: "3923e9b1aec34a0b82a751bc07538108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:00.700508 25180 raft_consensus.cc:979] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108: : Instructing follower 4d14d479dc4c4eb495fc26693b93fe47 to start an election
I20240502 01:55:00.700708 25180 raft_consensus.cc:1067] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Signalling peer 4d14d479dc4c4eb495fc26693b93fe47 to start an election
I20240502 01:55:00.701339 25014 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b"
dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
from {username='slave'} at 127.0.0.1:44818
I20240502 01:55:00.701570 25014 raft_consensus.cc:482] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:00.701696 25014 raft_consensus.cc:3037] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.703594 25014 raft_consensus.cc:504] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.704111 25014 leader_election.cc:288] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 2 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:55:00.704581 24936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:55:00.704603 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:55:00.704887 25089 raft_consensus.cc:3037] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.704864 24936 raft_consensus.cc:3032] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:55:00.705021 24936 raft_consensus.cc:729] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:00.705297 24936 consensus_queue.cc:260] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.705672 24936 raft_consensus.cc:3037] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:00.707866 25089 raft_consensus.cc:2454] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 2.
I20240502 01:55:00.708284 24978 leader_election.cc:302] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d14d479dc4c4eb495fc26693b93fe47, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:00.708434 24936 raft_consensus.cc:2454] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 2.
I20240502 01:55:00.708540 25177 raft_consensus.cc:2781] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:55:00.708729 25177 raft_consensus.cc:686] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 LEADER]: Becoming Leader. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:55:00.708969 25177 consensus_queue.cc:237] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:00.709906 24936 raft_consensus.cc:1261] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Refusing update from remote peer 4d14d479dc4c4eb495fc26693b93fe47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:00.710363 25177 consensus_queue.cc:1035] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:00.711176 24831 catalog_manager.cc:5484] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 reported cstate change: term changed from 1 to 2, leader changed from 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1) to 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2). New cstate: current_term: 2 leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:00.713167 25089 raft_consensus.cc:1261] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Refusing update from remote peer 4d14d479dc4c4eb495fc26693b93fe47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:00.713822 25163 consensus_queue.cc:1035] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:00.745601 25014 raft_consensus.cc:1261] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:00.746079 25180 consensus_queue.cc:1035] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:00.748735 25089 raft_consensus.cc:1261] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:00.749403 25180 consensus_queue.cc:1035] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:00.789487 25014 raft_consensus.cc:1261] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:00.789952 25180 consensus_queue.cc:1035] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:00.792662 25089 raft_consensus.cc:1261] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:00.793228 25138 consensus_queue.cc:1035] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:00.826571 25089 raft_consensus.cc:1261] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:00.827042 25138 consensus_queue.cc:1035] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:00.830468 25014 raft_consensus.cc:1261] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:00.831000 25138 consensus_queue.cc:1035] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:00.840472 24936 raft_consensus.cc:1261] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Refusing update from remote peer bf2089c824504bfa852e91a4d4589a57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:00.840900 25170 consensus_queue.cc:1035] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:00.843590 25014 raft_consensus.cc:1261] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Refusing update from remote peer bf2089c824504bfa852e91a4d4589a57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:00.844072 25170 consensus_queue.cc:1035] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:00.931967 25089 raft_consensus.cc:1261] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:00.932437 25138 consensus_queue.cc:1035] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:00.935493 25014 raft_consensus.cc:1261] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:00.936046 25180 consensus_queue.cc:1035] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:01.320700 24936 raft_consensus.cc:1261] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Refusing update from remote peer 4d14d479dc4c4eb495fc26693b93fe47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:01.321228 25222 consensus_queue.cc:1035] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:01.322844 25089 raft_consensus.cc:1261] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Refusing update from remote peer 4d14d479dc4c4eb495fc26693b93fe47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:01.323387 25222 consensus_queue.cc:1035] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:03.135690 24320 auto_leader_rebalancer-test.cc:331] The leader distribution is
I20240502 01:55:03.135967 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:03.143375 24936 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1845a5cb815d4d4bb0ba950ce3923502"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
mode: GRACEFUL
new_leader_uuid: "bf2089c824504bfa852e91a4d4589a57"
from {username='slave'} at 127.0.0.1:43648
I20240502 01:55:03.143606 24936 raft_consensus.cc:595] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Received request to transfer leadership to TS bf2089c824504bfa852e91a4d4589a57
I20240502 01:55:03.149183 25014 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9"
dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
mode: GRACEFUL
new_leader_uuid: "bf2089c824504bfa852e91a4d4589a57"
from {username='slave'} at 127.0.0.1:44834
I20240502 01:55:03.149376 25014 raft_consensus.cc:595] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 LEADER]: Received request to transfer leadership to TS bf2089c824504bfa852e91a4d4589a57
I20240502 01:55:03.149809 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240502 01:55:03.150004 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:03.207319 25232 raft_consensus.cc:979] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47: : Instructing follower bf2089c824504bfa852e91a4d4589a57 to start an election
I20240502 01:55:03.207481 25232 raft_consensus.cc:1067] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 LEADER]: Signalling peer bf2089c824504bfa852e91a4d4589a57 to start an election
I20240502 01:55:03.208062 25089 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9"
dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
from {username='slave'} at 127.0.0.1:60328
I20240502 01:55:03.208237 25089 raft_consensus.cc:482] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:03.208370 25089 raft_consensus.cc:3037] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:03.210191 25089 raft_consensus.cc:504] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:03.210726 25089 leader_election.cc:288] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 3 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659)
I20240502 01:55:03.211078 25014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:03.211122 24936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:55:03.211266 25014 raft_consensus.cc:3032] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 01:55:03.211319 24936 raft_consensus.cc:3037] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:03.211357 25014 raft_consensus.cc:729] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:55:03.211649 25014 consensus_queue.cc:260] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:03.211935 25014 raft_consensus.cc:3037] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:03.213349 24936 raft_consensus.cc:2454] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 3.
I20240502 01:55:03.213730 25052 leader_election.cc:302] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:03.213945 25014 raft_consensus.cc:2454] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 3.
I20240502 01:55:03.214010 25227 raft_consensus.cc:2781] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:55:03.214664 25227 raft_consensus.cc:686] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 3 LEADER]: Becoming Leader. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Running, Role: LEADER
I20240502 01:55:03.214985 25227 consensus_queue.cc:237] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:03.217329 24832 catalog_manager.cc:5484] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 reported cstate change: term changed from 2 to 3, leader changed from 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2) to bf2089c824504bfa852e91a4d4589a57 (127.23.192.3). New cstate: current_term: 3 leader_uuid: "bf2089c824504bfa852e91a4d4589a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:03.257848 25228 raft_consensus.cc:979] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108: : Instructing follower bf2089c824504bfa852e91a4d4589a57 to start an election
I20240502 01:55:03.257968 25228 raft_consensus.cc:1067] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Signalling peer bf2089c824504bfa852e91a4d4589a57 to start an election
I20240502 01:55:03.258514 25089 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1845a5cb815d4d4bb0ba950ce3923502"
dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
from {username='slave'} at 127.0.0.1:60334
I20240502 01:55:03.258702 25089 raft_consensus.cc:482] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:03.258798 25089 raft_consensus.cc:3037] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:03.260600 25089 raft_consensus.cc:504] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:03.261140 25089 leader_election.cc:288] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 2 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659)
I20240502 01:55:03.261505 24936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1845a5cb815d4d4bb0ba950ce3923502" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:55:03.261579 25014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1845a5cb815d4d4bb0ba950ce3923502" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:03.261724 24936 raft_consensus.cc:3032] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:55:03.261747 25014 raft_consensus.cc:3037] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:03.261827 24936 raft_consensus.cc:729] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:03.262110 24936 consensus_queue.cc:260] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:03.262480 24936 raft_consensus.cc:3037] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:03.264503 25014 raft_consensus.cc:2454] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 2.
I20240502 01:55:03.264901 25053 leader_election.cc:302] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d14d479dc4c4eb495fc26693b93fe47, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:03.265112 24936 raft_consensus.cc:2454] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 2.
I20240502 01:55:03.265167 25227 raft_consensus.cc:2781] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:55:03.265341 25227 raft_consensus.cc:686] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 2 LEADER]: Becoming Leader. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Running, Role: LEADER
I20240502 01:55:03.265592 25227 consensus_queue.cc:237] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:03.267654 24832 catalog_manager.cc:5484] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 reported cstate change: term changed from 1 to 2, leader changed from 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1) to bf2089c824504bfa852e91a4d4589a57 (127.23.192.3). New cstate: current_term: 2 leader_uuid: "bf2089c824504bfa852e91a4d4589a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:03.687491 24936 raft_consensus.cc:1261] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Refusing update from remote peer bf2089c824504bfa852e91a4d4589a57: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:03.688001 25227 consensus_queue.cc:1035] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:03.692589 25014 raft_consensus.cc:1261] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Refusing update from remote peer bf2089c824504bfa852e91a4d4589a57: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:03.693171 25245 consensus_queue.cc:1035] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:03.717291 25014 raft_consensus.cc:1261] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Refusing update from remote peer bf2089c824504bfa852e91a4d4589a57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:03.717826 25227 consensus_queue.cc:1035] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:03.718725 24936 raft_consensus.cc:1261] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Refusing update from remote peer bf2089c824504bfa852e91a4d4589a57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:03.719310 25227 consensus_queue.cc:1035] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:04.150384 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:04.152113 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:04.152289 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:05.152601 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:05.154466 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:05.154639 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:06.154990 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:06.156677 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:06.156852 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:07.157179 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:07.158857 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:07.159015 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:08.159375 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:08.161098 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:08.161303 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:09.161617 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:09.164086 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:09.164305 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:10.164688 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:10.166599 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:10.166772 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:11.167297 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:11.170037 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:11.170323 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:12.170759 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:12.172410 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:12.172618 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:13.182730 24320 auto_leader_rebalancer-test.cc:350] The leader distribution is
I20240502 01:55:13.188254 25089 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1845a5cb815d4d4bb0ba950ce3923502"
dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
mode: GRACEFUL
new_leader_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:60336
I20240502 01:55:13.188513 25089 raft_consensus.cc:595] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 2 LEADER]: Received request to transfer leadership to TS 3923e9b1aec34a0b82a751bc07538108
I20240502 01:55:13.190397 25013 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b"
dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
mode: GRACEFUL
new_leader_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:44822
I20240502 01:55:13.190565 25013 raft_consensus.cc:595] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 LEADER]: Received request to transfer leadership to TS 3923e9b1aec34a0b82a751bc07538108
I20240502 01:55:13.192356 25013 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5b60a3bbfb2947aabeb73ef4cfd82165"
dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
mode: GRACEFUL
new_leader_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:44822
I20240502 01:55:13.192490 25013 raft_consensus.cc:595] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Received request to transfer leadership to TS 3923e9b1aec34a0b82a751bc07538108
I20240502 01:55:13.194208 25089 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9"
dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
mode: GRACEFUL
new_leader_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:60336
I20240502 01:55:13.194340 25089 raft_consensus.cc:595] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 3 LEADER]: Received request to transfer leadership to TS 3923e9b1aec34a0b82a751bc07538108
I20240502 01:55:13.287503 25251 raft_consensus.cc:979] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57: : Instructing follower 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:13.287645 25251 raft_consensus.cc:1067] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 3 LEADER]: Signalling peer 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:13.288192 24938 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:43620
I20240502 01:55:13.288355 24938 raft_consensus.cc:482] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:13.288443 24938 raft_consensus.cc:3037] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:55:13.290256 24938 raft_consensus.cc:504] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:13.290794 24938 leader_election.cc:288] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 4 election: Requested vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:55:13.291213 25013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:13.291286 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b2dfa9a4e814292a3c56a942c7a4ab9" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:55:13.291389 25013 raft_consensus.cc:3037] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:55:13.291471 25089 raft_consensus.cc:3032] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 01:55:13.291571 25089 raft_consensus.cc:729] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Running, Role: LEADER
I20240502 01:55:13.291854 25089 consensus_queue.cc:260] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:13.292174 25089 raft_consensus.cc:3037] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:55:13.293506 25013 raft_consensus.cc:2454] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 4.
I20240502 01:55:13.293906 24903 leader_election.cc:302] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:55:13.294106 25089 raft_consensus.cc:2454] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 4.
I20240502 01:55:13.294184 25255 raft_consensus.cc:2781] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 01:55:13.294623 25255 raft_consensus.cc:686] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 4 LEADER]: Becoming Leader. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:13.294975 25255 consensus_queue.cc:237] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:13.297282 24831 catalog_manager.cc:5484] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 reported cstate change: term changed from 3 to 4, leader changed from bf2089c824504bfa852e91a4d4589a57 (127.23.192.3) to 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1). New cstate: current_term: 4 leader_uuid: "3923e9b1aec34a0b82a751bc07538108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:13.350581 25253 raft_consensus.cc:979] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47: : Instructing follower 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:13.350732 25253 raft_consensus.cc:1067] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 LEADER]: Signalling peer 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:13.351270 24938 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:43630
I20240502 01:55:13.351423 24938 raft_consensus.cc:482] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:13.351538 24938 raft_consensus.cc:3037] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:13.353268 24938 raft_consensus.cc:504] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:13.353822 24938 leader_election.cc:288] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 3 election: Requested vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:55:13.354132 25013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:13.354234 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:55:13.354364 25013 raft_consensus.cc:3032] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 01:55:13.354389 25089 raft_consensus.cc:3037] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:13.354460 25013 raft_consensus.cc:729] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:55:13.354692 25013 consensus_queue.cc:260] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:13.355007 25013 raft_consensus.cc:3037] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:13.356454 25089 raft_consensus.cc:2454] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 3.
I20240502 01:55:13.356781 24902 leader_election.cc:302] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:13.356896 25013 raft_consensus.cc:2454] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 3.
I20240502 01:55:13.357028 25255 raft_consensus.cc:2781] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:55:13.357189 25255 raft_consensus.cc:686] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 3 LEADER]: Becoming Leader. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:13.357434 25255 consensus_queue.cc:237] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:13.359637 24831 catalog_manager.cc:5484] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 reported cstate change: term changed from 2 to 3, leader changed from 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2) to 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1). New cstate: current_term: 3 leader_uuid: "3923e9b1aec34a0b82a751bc07538108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:13.515239 25263 raft_consensus.cc:979] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47: : Instructing follower 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:13.515388 25263 raft_consensus.cc:1067] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Signalling peer 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:13.515981 24938 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5b60a3bbfb2947aabeb73ef4cfd82165"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:43630
I20240502 01:55:13.516156 24938 raft_consensus.cc:482] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:13.516237 24938 raft_consensus.cc:3037] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:13.518158 24938 raft_consensus.cc:504] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:13.518687 24938 leader_election.cc:288] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 2 election: Requested vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:55:13.519150 25013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b60a3bbfb2947aabeb73ef4cfd82165" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:13.519233 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b60a3bbfb2947aabeb73ef4cfd82165" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:55:13.519346 25013 raft_consensus.cc:3032] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:55:13.519433 25013 raft_consensus.cc:729] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:55:13.519469 25089 raft_consensus.cc:3037] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:13.519704 25013 consensus_queue.cc:260] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:13.520076 25013 raft_consensus.cc:3037] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:13.521692 25089 raft_consensus.cc:2454] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 2.
I20240502 01:55:13.521992 25013 raft_consensus.cc:2454] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 2.
I20240502 01:55:13.522099 24902 leader_election.cc:302] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:13.522390 25255 raft_consensus.cc:2781] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:55:13.522512 25255 raft_consensus.cc:686] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Becoming Leader. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:13.522784 25255 consensus_queue.cc:237] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:13.525188 24831 catalog_manager.cc:5484] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 reported cstate change: term changed from 1 to 2, leader changed from 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2) to 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1). New cstate: current_term: 2 leader_uuid: "3923e9b1aec34a0b82a751bc07538108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:13.592656 25256 raft_consensus.cc:979] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57: : Instructing follower 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:13.592804 25256 raft_consensus.cc:1067] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 2 LEADER]: Signalling peer 3923e9b1aec34a0b82a751bc07538108 to start an election
I20240502 01:55:13.593418 24938 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1845a5cb815d4d4bb0ba950ce3923502"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
from {username='slave'} at 127.0.0.1:43620
I20240502 01:55:13.593592 24938 raft_consensus.cc:482] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:13.593688 24938 raft_consensus.cc:3037] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:13.595532 24938 raft_consensus.cc:504] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:13.596062 24938 leader_election.cc:288] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 3 election: Requested vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:55:13.596474 25013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1845a5cb815d4d4bb0ba950ce3923502" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:13.596509 25089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1845a5cb815d4d4bb0ba950ce3923502" candidate_uuid: "3923e9b1aec34a0b82a751bc07538108" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:55:13.596675 25089 raft_consensus.cc:3032] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 01:55:13.596680 25013 raft_consensus.cc:3037] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:13.596773 25089 raft_consensus.cc:729] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Running, Role: LEADER
I20240502 01:55:13.596998 25089 consensus_queue.cc:260] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:13.597306 25089 raft_consensus.cc:3037] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:13.598726 25013 raft_consensus.cc:2454] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 3.
I20240502 01:55:13.599128 24903 leader_election.cc:302] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3923e9b1aec34a0b82a751bc07538108, 4d14d479dc4c4eb495fc26693b93fe47; no voters:
I20240502 01:55:13.599357 25255 raft_consensus.cc:2781] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:55:13.599329 25089 raft_consensus.cc:2454] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3923e9b1aec34a0b82a751bc07538108 in term 3.
I20240502 01:55:13.599532 25255 raft_consensus.cc:686] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 3 LEADER]: Becoming Leader. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:13.599803 25255 consensus_queue.cc:237] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:13.602216 24831 catalog_manager.cc:5484] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 reported cstate change: term changed from 2 to 3, leader changed from bf2089c824504bfa852e91a4d4589a57 (127.23.192.3) to 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1). New cstate: current_term: 3 leader_uuid: "3923e9b1aec34a0b82a751bc07538108" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:13.759061 25013 raft_consensus.cc:1261] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 4 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 01:55:13.759575 25255 consensus_queue.cc:1035] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:13.764037 25089 raft_consensus.cc:1261] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 4 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 01:55:13.764721 25257 consensus_queue.cc:1035] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:13.880714 25088 raft_consensus.cc:1261] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:13.881168 25257 consensus_queue.cc:1035] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:13.884456 25013 raft_consensus.cc:1261] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:13.885007 25273 consensus_queue.cc:1035] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:13.930240 25013 raft_consensus.cc:1261] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:13.930648 25273 consensus_queue.cc:1035] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:13.933537 25088 raft_consensus.cc:1261] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240502 01:55:13.934240 25257 consensus_queue.cc:1035] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:14.193517 25088 raft_consensus.cc:1261] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:14.194111 25257 consensus_queue.cc:1035] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:14.197199 25013 raft_consensus.cc:1261] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Refusing update from remote peer 3923e9b1aec34a0b82a751bc07538108: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:14.197759 25273 consensus_queue.cc:1035] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:16.207726 24320 auto_leader_rebalancer-test.cc:365] The leader distribution is
I20240502 01:55:16.208002 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:16.210130 24938 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
mode: GRACEFUL
new_leader_uuid: "bf2089c824504bfa852e91a4d4589a57"
from {username='slave'} at 127.0.0.1:43648
I20240502 01:55:16.210348 24938 raft_consensus.cc:595] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 3 LEADER]: Received request to transfer leadership to TS bf2089c824504bfa852e91a4d4589a57
I20240502 01:55:16.211238 24938 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "941c5a2c0f1148e1b91600c3b3c75b60"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
mode: GRACEFUL
new_leader_uuid: "bf2089c824504bfa852e91a4d4589a57"
from {username='slave'} at 127.0.0.1:43648
I20240502 01:55:16.211412 24938 raft_consensus.cc:595] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Received request to transfer leadership to TS bf2089c824504bfa852e91a4d4589a57
I20240502 01:55:16.212180 24938 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
mode: GRACEFUL
new_leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
from {username='slave'} at 127.0.0.1:43648
I20240502 01:55:16.212332 24938 raft_consensus.cc:595] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Received request to transfer leadership to TS 4d14d479dc4c4eb495fc26693b93fe47
I20240502 01:55:16.213126 24938 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b"
dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
mode: GRACEFUL
new_leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
from {username='slave'} at 127.0.0.1:43648
I20240502 01:55:16.213279 24938 raft_consensus.cc:595] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Received request to transfer leadership to TS 4d14d479dc4c4eb495fc26693b93fe47
I20240502 01:55:16.213658 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 4
I20240502 01:55:16.213851 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:16.220957 25273 raft_consensus.cc:979] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108: : Instructing follower 4d14d479dc4c4eb495fc26693b93fe47 to start an election
I20240502 01:55:16.221130 25280 raft_consensus.cc:1067] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Signalling peer 4d14d479dc4c4eb495fc26693b93fe47 to start an election
I20240502 01:55:16.221736 25013 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b"
dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
from {username='slave'} at 127.0.0.1:44818
I20240502 01:55:16.221887 25013 raft_consensus.cc:482] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:16.222010 25013 raft_consensus.cc:3037] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:16.224150 25013 raft_consensus.cc:504] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:16.224875 25013 leader_election.cc:288] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 3 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:55:16.225163 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:55:16.225260 25088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e16fdce22f33489ca383343f0b66da1b" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:55:16.225375 24938 raft_consensus.cc:3032] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 01:55:16.225404 25088 raft_consensus.cc:3037] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:16.225466 24938 raft_consensus.cc:729] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:16.225754 24938 consensus_queue.cc:260] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:16.226112 24938 raft_consensus.cc:3037] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:16.228324 25088 raft_consensus.cc:2454] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 3.
I20240502 01:55:16.228761 24978 leader_election.cc:302] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d14d479dc4c4eb495fc26693b93fe47, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:16.228782 24938 raft_consensus.cc:2454] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 3.
I20240502 01:55:16.229104 25263 raft_consensus.cc:2781] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:55:16.229478 25263 raft_consensus.cc:686] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 LEADER]: Becoming Leader. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:55:16.229748 25263 consensus_queue.cc:237] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:16.232334 24831 catalog_manager.cc:5484] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 reported cstate change: term changed from 2 to 3, leader changed from 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1) to 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2). New cstate: current_term: 3 leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:16.431524 25273 raft_consensus.cc:979] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108: : Instructing follower bf2089c824504bfa852e91a4d4589a57 to start an election
I20240502 01:55:16.431721 25280 raft_consensus.cc:1067] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Signalling peer bf2089c824504bfa852e91a4d4589a57 to start an election
I20240502 01:55:16.432332 25088 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "941c5a2c0f1148e1b91600c3b3c75b60"
dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
from {username='slave'} at 127.0.0.1:60334
I20240502 01:55:16.432538 25088 raft_consensus.cc:482] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:16.432643 25088 raft_consensus.cc:3037] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:16.434496 25088 raft_consensus.cc:504] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:55:16.435313 25088 leader_election.cc:288] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 3 election: Requested vote from peers 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659), 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575)
I20240502 01:55:16.435644 25013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "941c5a2c0f1148e1b91600c3b3c75b60" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:16.435753 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "941c5a2c0f1148e1b91600c3b3c75b60" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:55:16.435871 25013 raft_consensus.cc:3037] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:16.435973 24938 raft_consensus.cc:3032] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 01:55:16.436054 24938 raft_consensus.cc:729] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:16.436333 24938 consensus_queue.cc:260] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:55:16.436648 24938 raft_consensus.cc:3037] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:16.437878 25013 raft_consensus.cc:2454] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 3.
I20240502 01:55:16.438244 25053 leader_election.cc:302] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d14d479dc4c4eb495fc26693b93fe47, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:16.438505 25256 raft_consensus.cc:2781] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:55:16.438673 24938 raft_consensus.cc:2454] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 3.
I20240502 01:55:16.439103 25256 raft_consensus.cc:686] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 3 LEADER]: Becoming Leader. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Running, Role: LEADER
I20240502 01:55:16.439456 25256 consensus_queue.cc:237] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } }
I20240502 01:55:16.441912 24831 catalog_manager.cc:5484] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 reported cstate change: term changed from 2 to 3, leader changed from 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1) to bf2089c824504bfa852e91a4d4589a57 (127.23.192.3). New cstate: current_term: 3 leader_uuid: "bf2089c824504bfa852e91a4d4589a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:16.461755 25273 raft_consensus.cc:979] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108: : Instructing follower 4d14d479dc4c4eb495fc26693b93fe47 to start an election
I20240502 01:55:16.461899 25273 raft_consensus.cc:1067] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Signalling peer 4d14d479dc4c4eb495fc26693b93fe47 to start an election
I20240502 01:55:16.462468 25013 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c"
dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
from {username='slave'} at 127.0.0.1:44818
I20240502 01:55:16.462630 25013 raft_consensus.cc:482] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:16.462749 25013 raft_consensus.cc:3037] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:16.464478 25013 raft_consensus.cc:504] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:16.464991 25013 leader_election.cc:288] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 3 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), bf2089c824504bfa852e91a4d4589a57 (127.23.192.3:32901)
I20240502 01:55:16.465339 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:55:16.465425 25088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab06fdd748c4fef8c8050407ed3628c" candidate_uuid: "4d14d479dc4c4eb495fc26693b93fe47" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
I20240502 01:55:16.465549 24938 raft_consensus.cc:3032] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Stepping down as leader of term 2
I20240502 01:55:16.465606 25088 raft_consensus.cc:3037] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:16.465647 24938 raft_consensus.cc:729] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:16.465917 24938 consensus_queue.cc:260] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:16.466249 24938 raft_consensus.cc:3037] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:16.467717 25088 raft_consensus.cc:2454] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 3.
I20240502 01:55:16.468047 24978 leader_election.cc:302] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d14d479dc4c4eb495fc26693b93fe47, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:16.468329 25263 raft_consensus.cc:2781] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:55:16.468335 24938 raft_consensus.cc:2454] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d14d479dc4c4eb495fc26693b93fe47 in term 3.
I20240502 01:55:16.468518 25263 raft_consensus.cc:686] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 LEADER]: Becoming Leader. State: Replica: 4d14d479dc4c4eb495fc26693b93fe47, State: Running, Role: LEADER
I20240502 01:55:16.468776 25263 consensus_queue.cc:237] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:16.471130 24831 catalog_manager.cc:5484] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 reported cstate change: term changed from 2 to 3, leader changed from 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1) to 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2). New cstate: current_term: 3 leader_uuid: "4d14d479dc4c4eb495fc26693b93fe47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:16.497084 25280 raft_consensus.cc:979] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108: : Instructing follower bf2089c824504bfa852e91a4d4589a57 to start an election
I20240502 01:55:16.497208 25280 raft_consensus.cc:1067] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 3 LEADER]: Signalling peer bf2089c824504bfa852e91a4d4589a57 to start an election
I20240502 01:55:16.497742 25088 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b"
dest_uuid: "bf2089c824504bfa852e91a4d4589a57"
from {username='slave'} at 127.0.0.1:60334
I20240502 01:55:16.497903 25088 raft_consensus.cc:482] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:55:16.497980 25088 raft_consensus.cc:3037] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:55:16.499686 25088 raft_consensus.cc:504] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:16.500180 25088 leader_election.cc:288] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 4 election: Requested vote from peers 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575), 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659)
I20240502 01:55:16.500495 24938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3923e9b1aec34a0b82a751bc07538108"
I20240502 01:55:16.500552 25013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859cb0d5e09845b1a59ca9f933a0588b" candidate_uuid: "bf2089c824504bfa852e91a4d4589a57" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d14d479dc4c4eb495fc26693b93fe47"
I20240502 01:55:16.500730 24938 raft_consensus.cc:3032] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 3 LEADER]: Stepping down as leader of term 3
I20240502 01:55:16.500753 25013 raft_consensus.cc:3037] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:55:16.500833 24938 raft_consensus.cc:729] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3923e9b1aec34a0b82a751bc07538108, State: Running, Role: LEADER
I20240502 01:55:16.501104 24938 consensus_queue.cc:260] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:16.501451 24938 raft_consensus.cc:3037] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Advancing to term 4
I20240502 01:55:16.503556 25013 raft_consensus.cc:2454] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 4.
I20240502 01:55:16.503993 25053 leader_election.cc:302] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d14d479dc4c4eb495fc26693b93fe47, bf2089c824504bfa852e91a4d4589a57; no voters:
I20240502 01:55:16.504042 24938 raft_consensus.cc:2454] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf2089c824504bfa852e91a4d4589a57 in term 4.
I20240502 01:55:16.504290 25256 raft_consensus.cc:2781] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 01:55:16.504477 25256 raft_consensus.cc:686] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 4 LEADER]: Becoming Leader. State: Replica: bf2089c824504bfa852e91a4d4589a57, State: Running, Role: LEADER
I20240502 01:55:16.504719 25256 consensus_queue.cc:237] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } }
I20240502 01:55:16.506786 24831 catalog_manager.cc:5484] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 reported cstate change: term changed from 3 to 4, leader changed from 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1) to bf2089c824504bfa852e91a4d4589a57 (127.23.192.3). New cstate: current_term: 4 leader_uuid: "bf2089c824504bfa852e91a4d4589a57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:16.667562 25088 raft_consensus.cc:1261] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Refusing update from remote peer 4d14d479dc4c4eb495fc26693b93fe47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:16.668052 25263 consensus_queue.cc:1035] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:16.672153 24938 raft_consensus.cc:1261] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Refusing update from remote peer 4d14d479dc4c4eb495fc26693b93fe47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:16.672793 25263 consensus_queue.cc:1035] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:16.886333 25088 raft_consensus.cc:1261] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Refusing update from remote peer 4d14d479dc4c4eb495fc26693b93fe47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:16.886333 24938 raft_consensus.cc:1261] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Refusing update from remote peer 4d14d479dc4c4eb495fc26693b93fe47: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:16.886956 25263 consensus_queue.cc:1035] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:16.887220 25281 consensus_queue.cc:1035] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf2089c824504bfa852e91a4d4589a57" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:16.920565 25013 raft_consensus.cc:1261] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Refusing update from remote peer bf2089c824504bfa852e91a4d4589a57: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:16.921072 25256 consensus_queue.cc:1035] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:16.924772 24938 raft_consensus.cc:1261] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Refusing update from remote peer bf2089c824504bfa852e91a4d4589a57: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:16.926123 25300 consensus_queue.cc:1035] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:17.003906 25013 raft_consensus.cc:1261] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 4 FOLLOWER]: Refusing update from remote peer bf2089c824504bfa852e91a4d4589a57: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 01:55:17.004426 25300 consensus_queue.cc:1035] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d14d479dc4c4eb495fc26693b93fe47" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 35659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:17.007859 24938 raft_consensus.cc:1261] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 4 FOLLOWER]: Refusing update from remote peer bf2089c824504bfa852e91a4d4589a57: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240502 01:55:17.008697 25300 consensus_queue.cc:1035] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3923e9b1aec34a0b82a751bc07538108" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:17.214181 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:17.215869 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:17.216048 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:18.216398 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:18.218055 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:18.218214 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:19.218524 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:19.220144 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:19.220320 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:20.220605 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:20.222266 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:20.222433 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:21.222800 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:21.224484 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:21.224655 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:22.224951 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:22.226583 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:22.226737 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:23.227053 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:23.228626 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:23.228793 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:24.229115 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:24.230741 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:24.230940 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:25.231272 24320 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240502 01:55:25.232930 24320 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240502 01:55:25.233104 24320 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240502 01:55:26.242563 24320 auto_leader_rebalancer-test.cc:376] The leader distribution is
I20240502 01:55:26.242758 24320 tablet_server.cc:178] TabletServer@127.23.192.1:0 shutting down...
W20240502 01:55:26.251003 24978 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20240502 01:55:26.252130 24320 ts_tablet_manager.cc:1470] Shutting down tablet manager...
W20240502 01:55:26.252327 24978 consensus_peers.cc:485] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 -> Peer 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575): Couldn't send request to peer 3923e9b1aec34a0b82a751bc07538108. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:26.252440 24320 tablet_replica.cc:330] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108: stopping tablet replica
I20240502 01:55:26.252631 24320 raft_consensus.cc:2229] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.252817 24320 raft_consensus.cc:2258] T b1b7aca14d2e4932bca0bd37af862620 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.253360 24320 tablet_replica.cc:330] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108: stopping tablet replica
I20240502 01:55:26.253530 24320 raft_consensus.cc:2229] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.253695 24320 raft_consensus.cc:2258] T e16fdce22f33489ca383343f0b66da1b P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.254168 24320 tablet_replica.cc:330] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108: stopping tablet replica
I20240502 01:55:26.254309 24320 raft_consensus.cc:2229] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.254460 24320 raft_consensus.cc:2258] T 1ed14d7889ab4d36aa93598e897f0b5d P 3923e9b1aec34a0b82a751bc07538108 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.254930 24320 tablet_replica.cc:330] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108: stopping tablet replica
I20240502 01:55:26.255105 24320 raft_consensus.cc:2229] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.255266 24320 raft_consensus.cc:2258] T 941c5a2c0f1148e1b91600c3b3c75b60 P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.255725 24320 tablet_replica.cc:330] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108: stopping tablet replica
I20240502 01:55:26.255875 24320 raft_consensus.cc:2229] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.256039 24320 raft_consensus.cc:2258] T dab06fdd748c4fef8c8050407ed3628c P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.256502 24320 tablet_replica.cc:330] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108: stopping tablet replica
I20240502 01:55:26.256665 24320 raft_consensus.cc:2229] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 3 LEADER]: Raft consensus shutting down.
W20240502 01:55:26.256780 25052 consensus_peers.cc:485] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 -> Peer 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575): Couldn't send request to peer 3923e9b1aec34a0b82a751bc07538108. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:26.256968 24320 raft_consensus.cc:2258] T 1845a5cb815d4d4bb0ba950ce3923502 P 3923e9b1aec34a0b82a751bc07538108 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.257359 24320 tablet_replica.cc:330] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108: stopping tablet replica
I20240502 01:55:26.257468 24320 raft_consensus.cc:2229] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.257591 24320 raft_consensus.cc:2258] T 859cb0d5e09845b1a59ca9f933a0588b P 3923e9b1aec34a0b82a751bc07538108 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.257936 24320 tablet_replica.cc:330] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108: stopping tablet replica
I20240502 01:55:26.258056 24320 raft_consensus.cc:2229] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Raft consensus shutting down.
I20240502 01:55:26.258256 24320 raft_consensus.cc:2258] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.258644 24320 tablet_replica.cc:330] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108: stopping tablet replica
I20240502 01:55:26.258746 24320 raft_consensus.cc:2229] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 4 LEADER]: Raft consensus shutting down.
I20240502 01:55:26.259001 24320 raft_consensus.cc:2258] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 3923e9b1aec34a0b82a751bc07538108 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.259379 24320 tablet_replica.cc:330] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108: stopping tablet replica
I20240502 01:55:26.259495 24320 raft_consensus.cc:2229] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 2 LEADER]: Raft consensus shutting down.
I20240502 01:55:26.259692 24320 raft_consensus.cc:2258] T e38d1bc02ed34a75885c87b895b99a16 P 3923e9b1aec34a0b82a751bc07538108 [term 2 FOLLOWER]: Raft consensus is shut down!
W20240502 01:55:26.272675 24978 consensus_peers.cc:485] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 -> Peer 3923e9b1aec34a0b82a751bc07538108 (127.23.192.1:43575): Couldn't send request to peer 3923e9b1aec34a0b82a751bc07538108. Status: Network error: Client connection negotiation failed: client connection to 127.23.192.1:43575: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:26.276360 24320 tablet_server.cc:194] TabletServer@127.23.192.1:0 shutdown complete.
I20240502 01:55:26.280455 24320 tablet_server.cc:178] TabletServer@127.23.192.2:0 shutting down...
I20240502 01:55:26.298470 24320 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 01:55:26.298682 24320 tablet_replica.cc:330] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47: stopping tablet replica
I20240502 01:55:26.298902 24320 raft_consensus.cc:2229] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.299036 24320 raft_consensus.cc:2258] T b1b7aca14d2e4932bca0bd37af862620 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.299437 24320 tablet_replica.cc:330] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47: stopping tablet replica
I20240502 01:55:26.299546 24320 raft_consensus.cc:2229] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 LEADER]: Raft consensus shutting down.
I20240502 01:55:26.299739 24320 raft_consensus.cc:2258] T e16fdce22f33489ca383343f0b66da1b P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.300123 24320 tablet_replica.cc:330] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47: stopping tablet replica
I20240502 01:55:26.300223 24320 raft_consensus.cc:2229] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.300325 24320 raft_consensus.cc:2258] T 941c5a2c0f1148e1b91600c3b3c75b60 P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.300670 24320 tablet_replica.cc:330] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47: stopping tablet replica
I20240502 01:55:26.300773 24320 raft_consensus.cc:2229] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 LEADER]: Raft consensus shutting down.
I20240502 01:55:26.300971 24320 raft_consensus.cc:2258] T 1ed14d7889ab4d36aa93598e897f0b5d P 4d14d479dc4c4eb495fc26693b93fe47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.301316 24320 tablet_replica.cc:330] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47: stopping tablet replica
I20240502 01:55:26.301419 24320 raft_consensus.cc:2229] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.301520 24320 raft_consensus.cc:2258] T 1845a5cb815d4d4bb0ba950ce3923502 P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.301858 24320 tablet_replica.cc:330] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47: stopping tablet replica
I20240502 01:55:26.301954 24320 raft_consensus.cc:2229] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 LEADER]: Raft consensus shutting down.
I20240502 01:55:26.302130 24320 raft_consensus.cc:2258] T dab06fdd748c4fef8c8050407ed3628c P 4d14d479dc4c4eb495fc26693b93fe47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.302485 24320 tablet_replica.cc:330] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47: stopping tablet replica
I20240502 01:55:26.302578 24320 raft_consensus.cc:2229] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.302682 24320 raft_consensus.cc:2258] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P 4d14d479dc4c4eb495fc26693b93fe47 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.303067 24320 tablet_replica.cc:330] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47: stopping tablet replica
I20240502 01:55:26.303159 24320 raft_consensus.cc:2229] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.303253 24320 raft_consensus.cc:2258] T 5b60a3bbfb2947aabeb73ef4cfd82165 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.303586 24320 tablet_replica.cc:330] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47: stopping tablet replica
I20240502 01:55:26.303674 24320 raft_consensus.cc:2229] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.303771 24320 raft_consensus.cc:2258] T e38d1bc02ed34a75885c87b895b99a16 P 4d14d479dc4c4eb495fc26693b93fe47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.304091 24320 tablet_replica.cc:330] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47: stopping tablet replica
I20240502 01:55:26.304183 24320 raft_consensus.cc:2229] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.304279 24320 raft_consensus.cc:2258] T 859cb0d5e09845b1a59ca9f933a0588b P 4d14d479dc4c4eb495fc26693b93fe47 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.320389 24320 tablet_server.cc:194] TabletServer@127.23.192.2:0 shutdown complete.
W20240502 01:55:26.322003 25053 consensus_peers.cc:485] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 -> Peer 4d14d479dc4c4eb495fc26693b93fe47 (127.23.192.2:35659): Couldn't send request to peer 4d14d479dc4c4eb495fc26693b93fe47. Status: Network error: Client connection negotiation failed: client connection to 127.23.192.2:35659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:26.324906 24320 tablet_server.cc:178] TabletServer@127.23.192.3:0 shutting down...
I20240502 01:55:26.333252 24320 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240502 01:55:26.333492 24320 tablet_replica.cc:330] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57: stopping tablet replica
I20240502 01:55:26.333652 24320 raft_consensus.cc:2229] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.333811 24320 raft_consensus.cc:2258] T e16fdce22f33489ca383343f0b66da1b P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.334229 24320 tablet_replica.cc:330] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57: stopping tablet replica
I20240502 01:55:26.334355 24320 raft_consensus.cc:2229] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 4 LEADER]: Raft consensus shutting down.
I20240502 01:55:26.334565 24320 raft_consensus.cc:2258] T 859cb0d5e09845b1a59ca9f933a0588b P bf2089c824504bfa852e91a4d4589a57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.334988 24320 tablet_replica.cc:330] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57: stopping tablet replica
I20240502 01:55:26.335112 24320 raft_consensus.cc:2229] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.335346 24320 raft_consensus.cc:2258] T e38d1bc02ed34a75885c87b895b99a16 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.335791 24320 tablet_replica.cc:330] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57: stopping tablet replica
I20240502 01:55:26.335917 24320 raft_consensus.cc:2229] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.336033 24320 raft_consensus.cc:2258] T 7b2dfa9a4e814292a3c56a942c7a4ab9 P bf2089c824504bfa852e91a4d4589a57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.336405 24320 tablet_replica.cc:330] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57: stopping tablet replica
I20240502 01:55:26.336526 24320 raft_consensus.cc:2229] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.336655 24320 raft_consensus.cc:2258] T 5b60a3bbfb2947aabeb73ef4cfd82165 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.337023 24320 tablet_replica.cc:330] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57: stopping tablet replica
I20240502 01:55:26.337138 24320 raft_consensus.cc:2229] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 3 LEADER]: Raft consensus shutting down.
I20240502 01:55:26.337340 24320 raft_consensus.cc:2258] T 941c5a2c0f1148e1b91600c3b3c75b60 P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.337730 24320 tablet_replica.cc:330] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57: stopping tablet replica
I20240502 01:55:26.337844 24320 raft_consensus.cc:2229] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.337954 24320 raft_consensus.cc:2258] T 1ed14d7889ab4d36aa93598e897f0b5d P bf2089c824504bfa852e91a4d4589a57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.338308 24320 tablet_replica.cc:330] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57: stopping tablet replica
I20240502 01:55:26.338419 24320 raft_consensus.cc:2229] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 2 LEADER]: Raft consensus shutting down.
I20240502 01:55:26.338639 24320 raft_consensus.cc:2258] T b1b7aca14d2e4932bca0bd37af862620 P bf2089c824504bfa852e91a4d4589a57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.339062 24320 tablet_replica.cc:330] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57: stopping tablet replica
I20240502 01:55:26.339171 24320 raft_consensus.cc:2229] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.339282 24320 raft_consensus.cc:2258] T 1845a5cb815d4d4bb0ba950ce3923502 P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.339644 24320 tablet_replica.cc:330] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57: stopping tablet replica
I20240502 01:55:26.339751 24320 raft_consensus.cc:2229] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:26.339867 24320 raft_consensus.cc:2258] T dab06fdd748c4fef8c8050407ed3628c P bf2089c824504bfa852e91a4d4589a57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.354568 24320 tablet_server.cc:194] TabletServer@127.23.192.3:0 shutdown complete.
I20240502 01:55:26.363135 24320 master.cc:537] Master@127.23.192.62:34497 shutting down...
I20240502 01:55:26.370246 24320 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 1 LEADER]: Raft consensus shutting down.
I20240502 01:55:26.370404 24320 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:26.370504 24320 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8ae06c74728d4e58a82b3b0a49332d27: stopping tablet replica
I20240502 01:55:26.383159 24320 master.cc:552] Master@127.23.192.62:34497 shutdown complete.
3923e9b1aec34a0b82a751bc07538108 5
4d14d479dc4c4eb495fc26693b93fe47 4
bf2089c824504bfa852e91a4d4589a57 1
3923e9b1aec34a0b82a751bc07538108 4
4d14d479dc4c4eb495fc26693b93fe47 3
bf2089c824504bfa852e91a4d4589a57 3
3923e9b1aec34a0b82a751bc07538108 8
4d14d479dc4c4eb495fc26693b93fe47 1
bf2089c824504bfa852e91a4d4589a57 1
3923e9b1aec34a0b82a751bc07538108 4
4d14d479dc4c4eb495fc26693b93fe47 3
bf2089c824504bfa852e91a4d4589a57 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (27489 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20240502 01:55:26.397747 24320 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.192.62:43317
I20240502 01:55:26.398185 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:55:26.400439 25314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:55:26.400717 25315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:55:26.401049 25317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:55:26.401535 24320 server_base.cc:1034] running on GCE node
I20240502 01:55:26.401754 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:55:26.401808 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:55:26.401835 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614926401832 us; error 0 us; skew 500 ppm
I20240502 01:55:26.401976 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:55:26.408113 24320 webserver.cc:460] Webserver started at http://127.23.192.62:44469/ using document root <none> and password file <none>
I20240502 01:55:26.408313 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:55:26.408372 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:55:26.408488 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:55:26.409034 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/master-0-root/instance:
uuid: "189a89b8651640b9a3ad55f4d8a977c3"
format_stamp: "Formatted at 2024-05-02 01:55:26 on dist-test-slave-kdrn"
I20240502 01:55:26.411273 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240502 01:55:26.412703 25322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:26.413101 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240502 01:55:26.413210 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/master-0-root
uuid: "189a89b8651640b9a3ad55f4d8a977c3"
format_stamp: "Formatted at 2024-05-02 01:55:26 on dist-test-slave-kdrn"
I20240502 01:55:26.413327 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:55:26.421170 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:55:26.421555 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:55:26.433346 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.62:43317
I20240502 01:55:26.433378 25373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.62:43317 every 8 connection(s)
I20240502 01:55:26.434463 25374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.438163 25374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3: Bootstrap starting.
I20240502 01:55:26.439345 25374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:26.440707 25374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3: No bootstrap required, opened a new log
I20240502 01:55:26.441195 25374 raft_consensus.cc:348] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189a89b8651640b9a3ad55f4d8a977c3" member_type: VOTER }
I20240502 01:55:26.441308 25374 raft_consensus.cc:374] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:26.441358 25374 raft_consensus.cc:729] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189a89b8651640b9a3ad55f4d8a977c3, State: Initialized, Role: FOLLOWER
I20240502 01:55:26.441543 25374 consensus_queue.cc:260] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189a89b8651640b9a3ad55f4d8a977c3" member_type: VOTER }
I20240502 01:55:26.441666 25374 raft_consensus.cc:388] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:55:26.441736 25374 raft_consensus.cc:482] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:55:26.441812 25374 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:26.443423 25374 raft_consensus.cc:504] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189a89b8651640b9a3ad55f4d8a977c3" member_type: VOTER }
I20240502 01:55:26.443598 25374 leader_election.cc:302] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 189a89b8651640b9a3ad55f4d8a977c3; no voters:
I20240502 01:55:26.443905 25374 leader_election.cc:288] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:55:26.444021 25377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:26.444445 25377 raft_consensus.cc:686] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [term 1 LEADER]: Becoming Leader. State: Replica: 189a89b8651640b9a3ad55f4d8a977c3, State: Running, Role: LEADER
I20240502 01:55:26.444690 25374 sys_catalog.cc:564] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:55:26.444658 25377 consensus_queue.cc:237] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189a89b8651640b9a3ad55f4d8a977c3" member_type: VOTER }
I20240502 01:55:26.445289 25379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 189a89b8651640b9a3ad55f4d8a977c3. Latest consensus state: current_term: 1 leader_uuid: "189a89b8651640b9a3ad55f4d8a977c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189a89b8651640b9a3ad55f4d8a977c3" member_type: VOTER } }
I20240502 01:55:26.445540 25379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [sys.catalog]: This master's current role is: LEADER
I20240502 01:55:26.445565 25378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "189a89b8651640b9a3ad55f4d8a977c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189a89b8651640b9a3ad55f4d8a977c3" member_type: VOTER } }
I20240502 01:55:26.445724 25378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3 [sys.catalog]: This master's current role is: LEADER
I20240502 01:55:26.447154 25382 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:55:26.448392 25382 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:55:26.450098 24320 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240502 01:55:26.451148 25382 catalog_manager.cc:1347] Generated new cluster ID: badb21049c6a4606abc9a4612254aadb
I20240502 01:55:26.451213 25382 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:55:26.458642 25382 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:55:26.459311 25382 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:55:26.468955 25382 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 189a89b8651640b9a3ad55f4d8a977c3: Generated new TSK 0
I20240502 01:55:26.469127 25382 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:55:26.482410 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:55:26.484719 25395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:55:26.485289 25398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:55:26.485532 25396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:55:26.485929 24320 server_base.cc:1034] running on GCE node
I20240502 01:55:26.486163 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:55:26.486217 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:55:26.486251 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614926486247 us; error 0 us; skew 500 ppm
I20240502 01:55:26.486378 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:55:26.487543 24320 webserver.cc:460] Webserver started at http://127.23.192.1:37349/ using document root <none> and password file <none>
I20240502 01:55:26.487736 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:55:26.487795 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:55:26.487908 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:55:26.488427 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-0-root/instance:
uuid: "481341cc6302403dab5dcc402f42a81f"
format_stamp: "Formatted at 2024-05-02 01:55:26 on dist-test-slave-kdrn"
I20240502 01:55:26.490653 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:55:26.492058 25403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:26.492339 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240502 01:55:26.492435 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-0-root
uuid: "481341cc6302403dab5dcc402f42a81f"
format_stamp: "Formatted at 2024-05-02 01:55:26 on dist-test-slave-kdrn"
I20240502 01:55:26.492532 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:55:26.533949 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:55:26.534399 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:55:26.534925 24320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:55:26.535689 24320 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:55:26.535742 24320 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:26.535809 24320 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:55:26.535842 24320 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:26.548750 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.1:39851
I20240502 01:55:26.548777 25466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.1:39851 every 8 connection(s)
I20240502 01:55:26.550218 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:55:26.553037 25472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:55:26.553828 25474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:55:26.553956 25471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:55:26.554217 24320 server_base.cc:1034] running on GCE node
I20240502 01:55:26.554489 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:55:26.554554 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:55:26.554597 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614926554589 us; error 0 us; skew 500 ppm
I20240502 01:55:26.554756 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:55:26.556142 24320 webserver.cc:460] Webserver started at http://127.23.192.2:45697/ using document root <none> and password file <none>
I20240502 01:55:26.556382 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:55:26.556452 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:55:26.556557 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:55:26.556882 25467 heartbeater.cc:347] Connected to a master server at 127.23.192.62:43317
I20240502 01:55:26.556999 25467 heartbeater.cc:464] Registering TS with master...
I20240502 01:55:26.557106 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-1-root/instance:
uuid: "77c36b03bf7c42a9a430cc595953aff9"
format_stamp: "Formatted at 2024-05-02 01:55:26 on dist-test-slave-kdrn"
I20240502 01:55:26.557332 25467 heartbeater.cc:511] Master 127.23.192.62:43317 requested a full tablet report, sending...
I20240502 01:55:26.558115 25339 ts_manager.cc:194] Registered new tserver with Master: 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851)
I20240502 01:55:26.559209 25339 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44518
I20240502 01:55:26.559500 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:55:26.560883 25479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:26.561195 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 01:55:26.561290 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-1-root
uuid: "77c36b03bf7c42a9a430cc595953aff9"
format_stamp: "Formatted at 2024-05-02 01:55:26 on dist-test-slave-kdrn"
I20240502 01:55:26.561384 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:55:26.595705 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:55:26.596177 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:55:26.596685 24320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:55:26.597411 24320 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:55:26.597462 24320 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:26.597514 24320 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:55:26.597555 24320 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:26.610447 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.2:37163
I20240502 01:55:26.610481 25541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.2:37163 every 8 connection(s)
I20240502 01:55:26.611855 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:55:26.614550 25545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:55:26.614784 25546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:55:26.615753 25548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:55:26.616137 24320 server_base.cc:1034] running on GCE node
I20240502 01:55:26.616467 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:55:26.616540 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:55:26.616603 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614926616599 us; error 0 us; skew 500 ppm
I20240502 01:55:26.616762 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:55:26.618062 24320 webserver.cc:460] Webserver started at http://127.23.192.3:39373/ using document root <none> and password file <none>
I20240502 01:55:26.618288 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:55:26.618314 25542 heartbeater.cc:347] Connected to a master server at 127.23.192.62:43317
I20240502 01:55:26.618353 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:55:26.618453 25542 heartbeater.cc:464] Registering TS with master...
I20240502 01:55:26.618484 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:55:26.618777 25542 heartbeater.cc:511] Master 127.23.192.62:43317 requested a full tablet report, sending...
I20240502 01:55:26.619102 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-2-root/instance:
uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
format_stamp: "Formatted at 2024-05-02 01:55:26 on dist-test-slave-kdrn"
I20240502 01:55:26.619611 25339 ts_manager.cc:194] Registered new tserver with Master: 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:26.620324 25339 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44526
I20240502 01:55:26.621600 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:26.622938 25553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:26.623251 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 01:55:26.623350 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-2-root
uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
format_stamp: "Formatted at 2024-05-02 01:55:26 on dist-test-slave-kdrn"
I20240502 01:55:26.623442 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:55:26.632877 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:55:26.633284 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:55:26.633755 24320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:55:26.634439 24320 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:55:26.634490 24320 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:26.634557 24320 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:55:26.634591 24320 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:26.646579 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.3:36291
I20240502 01:55:26.646612 25615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.3:36291 every 8 connection(s)
I20240502 01:55:26.652555 25616 heartbeater.cc:347] Connected to a master server at 127.23.192.62:43317
I20240502 01:55:26.652657 25616 heartbeater.cc:464] Registering TS with master...
I20240502 01:55:26.652947 25616 heartbeater.cc:511] Master 127.23.192.62:43317 requested a full tablet report, sending...
I20240502 01:55:26.653717 25339 ts_manager.cc:194] Registered new tserver with Master: a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:26.654114 24320 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.006732804s
I20240502 01:55:26.654453 25339 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44536
I20240502 01:55:26.655037 24320 test_util.cc:268] Using random seed: -442417607
I20240502 01:55:26.665261 25339 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44540:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240502 01:55:26.666512 25339 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240502 01:55:26.706341 25507 tablet_service.cc:1467] Processing CreateTablet for tablet 28f04f974e1b420f904c63cf6e1baa6b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240502 01:55:26.706877 25507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28f04f974e1b420f904c63cf6e1baa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.710019 25498 tablet_service.cc:1467] Processing CreateTablet for tablet 6bc6480138d14df397ca2db53ca652d2 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240502 01:55:26.710412 25498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bc6480138d14df397ca2db53ca652d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.713183 25499 tablet_service.cc:1467] Processing CreateTablet for tablet 082a20c28ee243268963c85be001faa7 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240502 01:55:26.713627 25499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 082a20c28ee243268963c85be001faa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.715188 25500 tablet_service.cc:1467] Processing CreateTablet for tablet 0f960dc60ff5402d8db16edd5ab3cb2d (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240502 01:55:26.715569 25500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f960dc60ff5402d8db16edd5ab3cb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.719172 25501 tablet_service.cc:1467] Processing CreateTablet for tablet 40e8e94fa76d49eebe0a9572ff2b3f12 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240502 01:55:26.719576 25501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40e8e94fa76d49eebe0a9572ff2b3f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.721428 25631 tablet_bootstrap.cc:492] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:26.723032 25631 tablet_bootstrap.cc:654] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:26.723167 25502 tablet_service.cc:1467] Processing CreateTablet for tablet 005b796aabf04ae79928bc4457a209db (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240502 01:55:26.723565 25502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 005b796aabf04ae79928bc4457a209db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.724745 25507 tablet_service.cc:1467] Processing CreateTablet for tablet 2f6789c3e6d44cff8e50f6a9af1a42e7 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240502 01:55:26.725095 25507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f6789c3e6d44cff8e50f6a9af1a42e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.727141 25503 tablet_service.cc:1467] Processing CreateTablet for tablet 02a8e17203f54aa7b857bf0768799d3b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240502 01:55:26.727532 25503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02a8e17203f54aa7b857bf0768799d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.731326 25507 tablet_service.cc:1467] Processing CreateTablet for tablet 10f64edf93e440f9b455caa1fcc9f3a4 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240502 01:55:26.731132 25504 tablet_service.cc:1467] Processing CreateTablet for tablet eaabd178eb5f44ae80af982a61550119 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240502 01:55:26.732095 25504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaabd178eb5f44ae80af982a61550119. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.735105 25506 tablet_service.cc:1467] Processing CreateTablet for tablet b90778aac3294e6c913dfe12245b17e1 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240502 01:55:26.735543 25506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b90778aac3294e6c913dfe12245b17e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.739105 25505 tablet_service.cc:1467] Processing CreateTablet for tablet 34fff5148ef24f36b798374c1bfc6f69 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240502 01:55:26.739523 25505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34fff5148ef24f36b798374c1bfc6f69. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.741647 25502 tablet_service.cc:1467] Processing CreateTablet for tablet e0276f38a2d94696b6387faa09120883 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240502 01:55:26.742091 25502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0276f38a2d94696b6387faa09120883. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.745878 25503 tablet_service.cc:1467] Processing CreateTablet for tablet f3b9d8250b2e491f8db5bde1649178cf (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240502 01:55:26.747129 25504 tablet_service.cc:1467] Processing CreateTablet for tablet 1b44011e7fc24cb085f97afa28a0295f (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240502 01:55:26.749231 25501 tablet_service.cc:1467] Processing CreateTablet for tablet a07dbbae54d745d49344fbaa9fe89f75 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240502 01:55:26.752297 25499 tablet_service.cc:1467] Processing CreateTablet for tablet c74d58e57f044068af88fcb359615ada (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240502 01:55:26.753041 25505 tablet_service.cc:1467] Processing CreateTablet for tablet 1f53a683b23346ae963d62ef4c84bee8 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240502 01:55:26.753401 25506 tablet_service.cc:1467] Processing CreateTablet for tablet 119ec541c59f445980a1f04ba3890990 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240502 01:55:26.753633 25500 tablet_service.cc:1467] Processing CreateTablet for tablet 5b64e37777a0493aa438b49a92d9f4fd (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240502 01:55:26.754247 25498 tablet_service.cc:1467] Processing CreateTablet for tablet ea9ec0f8b8514c50b369b7e89182da95 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240502 01:55:26.755136 25507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10f64edf93e440f9b455caa1fcc9f3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.755769 25500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b64e37777a0493aa438b49a92d9f4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.755925 25505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f53a683b23346ae963d62ef4c84bee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.758879 25503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3b9d8250b2e491f8db5bde1649178cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.759593 25506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119ec541c59f445980a1f04ba3890990. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.760141 25498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea9ec0f8b8514c50b369b7e89182da95. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.760294 25504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b44011e7fc24cb085f97afa28a0295f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.760586 25501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a07dbbae54d745d49344fbaa9fe89f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.760799 25499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c74d58e57f044068af88fcb359615ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.762791 25631 tablet_bootstrap.cc:492] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:26.762944 25631 ts_tablet_manager.cc:1367] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.042s user 0.018s sys 0.009s
I20240502 01:55:26.763583 25631 raft_consensus.cc:348] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:26.763727 25631 raft_consensus.cc:374] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:26.763784 25631 raft_consensus.cc:729] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:26.763976 25631 consensus_queue.cc:260] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:26.764721 25542 heartbeater.cc:503] Master 127.23.192.62:43317 was elected leader, sending a full tablet report...
I20240502 01:55:26.764734 25631 ts_tablet_manager.cc:1398] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:26.765849 25631 tablet_bootstrap.cc:492] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:26.772317 25500 tablet_service.cc:1467] Processing CreateTablet for tablet ef2c1bf82b7f4e5f8e079a9502e236b0 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240502 01:55:26.772696 25500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef2c1bf82b7f4e5f8e079a9502e236b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.773339 25631 tablet_bootstrap.cc:654] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:26.778863 25499 tablet_service.cc:1467] Processing CreateTablet for tablet 62d013793fcb4f2a9fe28d149040f721 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240502 01:55:26.779109 25432 tablet_service.cc:1467] Processing CreateTablet for tablet 28f04f974e1b420f904c63cf6e1baa6b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240502 01:55:26.779215 25499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62d013793fcb4f2a9fe28d149040f721. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.780098 25426 tablet_service.cc:1467] Processing CreateTablet for tablet 40e8e94fa76d49eebe0a9572ff2b3f12 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240502 01:55:26.780946 25426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40e8e94fa76d49eebe0a9572ff2b3f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.781008 25431 tablet_service.cc:1467] Processing CreateTablet for tablet b90778aac3294e6c913dfe12245b17e1 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240502 01:55:26.781440 25431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b90778aac3294e6c913dfe12245b17e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.781858 25425 tablet_service.cc:1467] Processing CreateTablet for tablet 0f960dc60ff5402d8db16edd5ab3cb2d (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240502 01:55:26.783553 25429 tablet_service.cc:1467] Processing CreateTablet for tablet eaabd178eb5f44ae80af982a61550119 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240502 01:55:26.783967 25424 tablet_service.cc:1467] Processing CreateTablet for tablet 082a20c28ee243268963c85be001faa7 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240502 01:55:26.784315 25425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f960dc60ff5402d8db16edd5ab3cb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.784953 25423 tablet_service.cc:1467] Processing CreateTablet for tablet 6bc6480138d14df397ca2db53ca652d2 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240502 01:55:26.785048 25428 tablet_service.cc:1467] Processing CreateTablet for tablet 02a8e17203f54aa7b857bf0768799d3b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240502 01:55:26.785357 25427 tablet_service.cc:1467] Processing CreateTablet for tablet 005b796aabf04ae79928bc4457a209db (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240502 01:55:26.784953 25430 tablet_service.cc:1467] Processing CreateTablet for tablet 34fff5148ef24f36b798374c1bfc6f69 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240502 01:55:26.786002 25432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28f04f974e1b420f904c63cf6e1baa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.786335 25505 tablet_service.cc:1467] Processing CreateTablet for tablet 45cdd96cf1414bf794042b2d514aa82a (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240502 01:55:26.786756 25505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45cdd96cf1414bf794042b2d514aa82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.786957 25423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bc6480138d14df397ca2db53ca652d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.787544 25429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaabd178eb5f44ae80af982a61550119. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.788108 25424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 082a20c28ee243268963c85be001faa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.788826 25631 tablet_bootstrap.cc:492] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:26.788944 25631 ts_tablet_manager.cc:1367] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.001s
I20240502 01:55:26.791275 25430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34fff5148ef24f36b798374c1bfc6f69. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.791472 25427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 005b796aabf04ae79928bc4457a209db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.792351 25428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02a8e17203f54aa7b857bf0768799d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.802075 25502 tablet_service.cc:1467] Processing CreateTablet for tablet 9fa192ac75ca4897be4bed9594502e7b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240502 01:55:26.802433 25502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fa192ac75ca4897be4bed9594502e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.805780 25501 tablet_service.cc:1467] Processing CreateTablet for tablet 3fafad230c13400391bdbba1ac1ee318 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240502 01:55:26.806167 25501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fafad230c13400391bdbba1ac1ee318. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.807852 25426 tablet_service.cc:1467] Processing CreateTablet for tablet 2f6789c3e6d44cff8e50f6a9af1a42e7 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240502 01:55:26.808189 25504 tablet_service.cc:1467] Processing CreateTablet for tablet 600040d630eb4fa9809d5d477c55dc41 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240502 01:55:26.808478 25426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f6789c3e6d44cff8e50f6a9af1a42e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.808555 25504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 600040d630eb4fa9809d5d477c55dc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.811013 25503 tablet_service.cc:1467] Processing CreateTablet for tablet 03251bf1c560469880b1ab407d24a810 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240502 01:55:26.811303 25503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03251bf1c560469880b1ab407d24a810. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.813464 25423 tablet_service.cc:1467] Processing CreateTablet for tablet 10f64edf93e440f9b455caa1fcc9f3a4 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240502 01:55:26.813820 25423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10f64edf93e440f9b455caa1fcc9f3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.814638 25500 tablet_service.cc:1467] Processing CreateTablet for tablet 47b72129270d4be3bf173be990d530f3 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240502 01:55:26.815155 25500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47b72129270d4be3bf173be990d530f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.817185 25425 tablet_service.cc:1467] Processing CreateTablet for tablet e0276f38a2d94696b6387faa09120883 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240502 01:55:26.817565 25425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0276f38a2d94696b6387faa09120883. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.822737 25500 tablet_service.cc:1467] Processing CreateTablet for tablet 8399bb471a684ee8880fdd9ad668fff3 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240502 01:55:26.823217 25500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8399bb471a684ee8880fdd9ad668fff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.824579 25424 tablet_service.cc:1467] Processing CreateTablet for tablet f3b9d8250b2e491f8db5bde1649178cf (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240502 01:55:26.824951 25424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3b9d8250b2e491f8db5bde1649178cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.825887 25431 tablet_service.cc:1467] Processing CreateTablet for tablet 1b44011e7fc24cb085f97afa28a0295f (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240502 01:55:26.826305 25431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b44011e7fc24cb085f97afa28a0295f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.827284 25631 raft_consensus.cc:348] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:26.827505 25631 raft_consensus.cc:374] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:26.827571 25631 raft_consensus.cc:729] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:26.827804 25631 consensus_queue.cc:260] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:26.828320 25631 ts_tablet_manager.cc:1398] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.039s user 0.000s sys 0.002s
I20240502 01:55:26.828398 25428 tablet_service.cc:1467] Processing CreateTablet for tablet a07dbbae54d745d49344fbaa9fe89f75 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240502 01:55:26.830034 25500 tablet_service.cc:1467] Processing CreateTablet for tablet 3c9855b1e8274e49a57434e6151b8e70 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240502 01:55:26.830423 25500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c9855b1e8274e49a57434e6151b8e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.832217 25505 tablet_service.cc:1467] Processing CreateTablet for tablet 1c0d4918f3994489a7289728ca82deff (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240502 01:55:26.832594 25505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c0d4918f3994489a7289728ca82deff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.833498 25430 tablet_service.cc:1467] Processing CreateTablet for tablet c74d58e57f044068af88fcb359615ada (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240502 01:55:26.834682 25631 tablet_bootstrap.cc:492] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:26.834955 25430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c74d58e57f044068af88fcb359615ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.835749 25426 tablet_service.cc:1467] Processing CreateTablet for tablet 1f53a683b23346ae963d62ef4c84bee8 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240502 01:55:26.836076 25426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f53a683b23346ae963d62ef4c84bee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.836239 25428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a07dbbae54d745d49344fbaa9fe89f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.837994 25432 tablet_service.cc:1467] Processing CreateTablet for tablet 119ec541c59f445980a1f04ba3890990 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240502 01:55:26.838464 25423 tablet_service.cc:1467] Processing CreateTablet for tablet 5b64e37777a0493aa438b49a92d9f4fd (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240502 01:55:26.838707 25499 tablet_service.cc:1467] Processing CreateTablet for tablet c6adb7e9b9fa4b858ce0f42b8416cc3c (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240502 01:55:26.838810 25423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b64e37777a0493aa438b49a92d9f4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.839418 25499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6adb7e9b9fa4b858ce0f42b8416cc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.841946 25429 tablet_service.cc:1467] Processing CreateTablet for tablet ea9ec0f8b8514c50b369b7e89182da95 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240502 01:55:26.847512 25432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119ec541c59f445980a1f04ba3890990. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.847656 25581 tablet_service.cc:1467] Processing CreateTablet for tablet 28f04f974e1b420f904c63cf6e1baa6b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240502 01:55:26.848460 25429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea9ec0f8b8514c50b369b7e89182da95. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.847860 25580 tablet_service.cc:1467] Processing CreateTablet for tablet b90778aac3294e6c913dfe12245b17e1 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240502 01:55:26.849829 25579 tablet_service.cc:1467] Processing CreateTablet for tablet 34fff5148ef24f36b798374c1bfc6f69 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240502 01:55:26.854158 25580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b90778aac3294e6c913dfe12245b17e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.852849 25578 tablet_service.cc:1467] Processing CreateTablet for tablet eaabd178eb5f44ae80af982a61550119 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240502 01:55:26.855332 25579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34fff5148ef24f36b798374c1bfc6f69. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.857154 25631 tablet_bootstrap.cc:654] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:26.857288 25581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28f04f974e1b420f904c63cf6e1baa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.854892 25576 tablet_service.cc:1467] Processing CreateTablet for tablet 005b796aabf04ae79928bc4457a209db (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240502 01:55:26.859218 25578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaabd178eb5f44ae80af982a61550119. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.857193 25577 tablet_service.cc:1467] Processing CreateTablet for tablet 02a8e17203f54aa7b857bf0768799d3b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240502 01:55:26.864665 25576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 005b796aabf04ae79928bc4457a209db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.863145 25572 tablet_service.cc:1467] Processing CreateTablet for tablet 6bc6480138d14df397ca2db53ca652d2 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240502 01:55:26.865931 25635 tablet_bootstrap.cc:492] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:26.866875 25574 tablet_service.cc:1467] Processing CreateTablet for tablet 0f960dc60ff5402d8db16edd5ab3cb2d (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
W20240502 01:55:26.868973 25543 tablet.cc:2369] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:55:26.870889 25498 tablet_service.cc:1467] Processing CreateTablet for tablet 4fab7be12223417a873e8747bb4ce8fd (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240502 01:55:26.870774 25500 tablet_service.cc:1467] Processing CreateTablet for tablet feaebca58bd448eb8769581e94dd493c (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240502 01:55:26.875025 25577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02a8e17203f54aa7b857bf0768799d3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.869047 25575 tablet_service.cc:1467] Processing CreateTablet for tablet 40e8e94fa76d49eebe0a9572ff2b3f12 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240502 01:55:26.872879 25573 tablet_service.cc:1467] Processing CreateTablet for tablet 082a20c28ee243268963c85be001faa7 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240502 01:55:26.880424 25498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fab7be12223417a873e8747bb4ce8fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.881489 25507 tablet_service.cc:1467] Processing CreateTablet for tablet 568a8db50f33400992fff1ff0b3f9505 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240502 01:55:26.883041 25500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet feaebca58bd448eb8769581e94dd493c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.883209 25572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bc6480138d14df397ca2db53ca652d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.886620 25506 tablet_service.cc:1467] Processing CreateTablet for tablet cda8a639a1914915a2caaf8362fe2643 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240502 01:55:26.889051 25507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 568a8db50f33400992fff1ff0b3f9505. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.892194 25424 tablet_service.cc:1467] Processing CreateTablet for tablet ef2c1bf82b7f4e5f8e079a9502e236b0 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240502 01:55:26.892321 25574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f960dc60ff5402d8db16edd5ab3cb2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.893503 25575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40e8e94fa76d49eebe0a9572ff2b3f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.895475 25506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cda8a639a1914915a2caaf8362fe2643. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.896364 25427 tablet_service.cc:1467] Processing CreateTablet for tablet 62d013793fcb4f2a9fe28d149040f721 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240502 01:55:26.897034 25573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 082a20c28ee243268963c85be001faa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.898113 25635 tablet_bootstrap.cc:654] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:26.899235 25424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef2c1bf82b7f4e5f8e079a9502e236b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.904843 25429 tablet_service.cc:1467] Processing CreateTablet for tablet 45cdd96cf1414bf794042b2d514aa82a (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240502 01:55:26.907058 25637 tablet_bootstrap.cc:492] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:26.911026 25426 tablet_service.cc:1467] Processing CreateTablet for tablet 9fa192ac75ca4897be4bed9594502e7b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240502 01:55:26.911906 25577 tablet_service.cc:1467] Processing CreateTablet for tablet 2f6789c3e6d44cff8e50f6a9af1a42e7 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240502 01:55:26.912348 25577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f6789c3e6d44cff8e50f6a9af1a42e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.917395 25427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62d013793fcb4f2a9fe28d149040f721. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.920691 25426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fa192ac75ca4897be4bed9594502e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.921429 25502 tablet_service.cc:1467] Processing CreateTablet for tablet 71689056867841e3aef8030fe4d2c58b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240502 01:55:26.921958 25574 tablet_service.cc:1467] Processing CreateTablet for tablet 10f64edf93e440f9b455caa1fcc9f3a4 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240502 01:55:26.923416 25429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45cdd96cf1414bf794042b2d514aa82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.925100 25581 tablet_service.cc:1467] Processing CreateTablet for tablet e0276f38a2d94696b6387faa09120883 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240502 01:55:26.926097 25574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10f64edf93e440f9b455caa1fcc9f3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.926463 25502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71689056867841e3aef8030fe4d2c58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.927676 25503 tablet_service.cc:1467] Processing CreateTablet for tablet fb34d5458b92443c92f78bc26f6b3804 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240502 01:55:26.928267 25581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0276f38a2d94696b6387faa09120883. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.929010 25503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb34d5458b92443c92f78bc26f6b3804. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.929948 25576 tablet_service.cc:1467] Processing CreateTablet for tablet f3b9d8250b2e491f8db5bde1649178cf (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240502 01:55:26.935261 25631 tablet_bootstrap.cc:492] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:26.935593 25576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3b9d8250b2e491f8db5bde1649178cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.939131 25631 ts_tablet_manager.cc:1367] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.101s user 0.017s sys 0.024s
I20240502 01:55:26.947644 25505 tablet_service.cc:1467] Processing CreateTablet for tablet 15cacbe419b1480f9ea528e3a31c32f3 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240502 01:55:26.951001 25505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15cacbe419b1480f9ea528e3a31c32f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.954066 25504 tablet_service.cc:1467] Processing CreateTablet for tablet cb89dc94017c476aa8377bf49fd2d07b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240502 01:55:26.954198 25501 tablet_service.cc:1467] Processing CreateTablet for tablet 1721db9e2cf341f98bad0f77824788ff (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240502 01:55:26.956534 25425 tablet_service.cc:1467] Processing CreateTablet for tablet 3fafad230c13400391bdbba1ac1ee318 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240502 01:55:26.956944 25504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb89dc94017c476aa8377bf49fd2d07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.957170 25501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1721db9e2cf341f98bad0f77824788ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.958511 25637 tablet_bootstrap.cc:654] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:26.959278 25425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fafad230c13400391bdbba1ac1ee318. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.959828 25423 tablet_service.cc:1467] Processing CreateTablet for tablet adfecdabe3c04439bddacefd7be19242 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240502 01:55:26.968011 25423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adfecdabe3c04439bddacefd7be19242. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.968348 25631 raft_consensus.cc:348] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:26.968895 25578 tablet_service.cc:1467] Processing CreateTablet for tablet 1b44011e7fc24cb085f97afa28a0295f (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240502 01:55:26.969261 25578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b44011e7fc24cb085f97afa28a0295f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.969529 25572 tablet_service.cc:1467] Processing CreateTablet for tablet a07dbbae54d745d49344fbaa9fe89f75 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240502 01:55:26.971264 25631 raft_consensus.cc:374] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:26.974689 25428 tablet_service.cc:1467] Processing CreateTablet for tablet 600040d630eb4fa9809d5d477c55dc41 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240502 01:55:26.975111 25428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 600040d630eb4fa9809d5d477c55dc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.975945 25572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a07dbbae54d745d49344fbaa9fe89f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.978349 25631 raft_consensus.cc:729] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:26.980433 25635 tablet_bootstrap.cc:492] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:26.981657 25631 consensus_queue.cc:260] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:26.982798 25432 tablet_service.cc:1467] Processing CreateTablet for tablet 03251bf1c560469880b1ab407d24a810 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240502 01:55:26.982858 25431 tablet_service.cc:1467] Processing CreateTablet for tablet 47b72129270d4be3bf173be990d530f3 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240502 01:55:26.983294 25432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03251bf1c560469880b1ab407d24a810. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.983956 25635 ts_tablet_manager.cc:1367] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.123s user 0.009s sys 0.021s
I20240502 01:55:26.984019 25580 tablet_service.cc:1467] Processing CreateTablet for tablet c74d58e57f044068af88fcb359615ada (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240502 01:55:26.984438 25580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c74d58e57f044068af88fcb359615ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.984908 25635 raft_consensus.cc:348] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:26.985124 25635 raft_consensus.cc:374] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:26.986032 25431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47b72129270d4be3bf173be990d530f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:26.989149 25635 raft_consensus.cc:729] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:26.993206 25579 tablet_service.cc:1467] Processing CreateTablet for tablet 1f53a683b23346ae963d62ef4c84bee8 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240502 01:55:26.994000 25635 consensus_queue.cc:260] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:26.999938 25579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f53a683b23346ae963d62ef4c84bee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.000381 25499 tablet_service.cc:1467] Processing CreateTablet for tablet e04d952325064d5a9414dbefca50ce1c (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240502 01:55:27.002200 25499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e04d952325064d5a9414dbefca50ce1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.002665 25577 tablet_service.cc:1467] Processing CreateTablet for tablet 119ec541c59f445980a1f04ba3890990 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240502 01:55:27.003099 25507 tablet_service.cc:1467] Processing CreateTablet for tablet adfecdabe3c04439bddacefd7be19242 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240502 01:55:27.010026 25507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adfecdabe3c04439bddacefd7be19242. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.010461 25430 tablet_service.cc:1467] Processing CreateTablet for tablet 8399bb471a684ee8880fdd9ad668fff3 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240502 01:55:27.010970 25577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119ec541c59f445980a1f04ba3890990. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.012434 25498 tablet_service.cc:1467] Processing CreateTablet for tablet 6dcf64b234454dbe8cb1ff3c2e3639d7 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240502 01:55:27.012763 25498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dcf64b234454dbe8cb1ff3c2e3639d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.016000 25573 tablet_service.cc:1467] Processing CreateTablet for tablet 5b64e37777a0493aa438b49a92d9f4fd (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240502 01:55:27.016317 25430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8399bb471a684ee8880fdd9ad668fff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.020239 25575 tablet_service.cc:1467] Processing CreateTablet for tablet ea9ec0f8b8514c50b369b7e89182da95 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240502 01:55:27.020790 25573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b64e37777a0493aa438b49a92d9f4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.021659 25575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea9ec0f8b8514c50b369b7e89182da95. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.026268 25427 tablet_service.cc:1467] Processing CreateTablet for tablet 3c9855b1e8274e49a57434e6151b8e70 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240502 01:55:27.026690 25427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c9855b1e8274e49a57434e6151b8e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.031709 25503 tablet_service.cc:1467] Processing CreateTablet for tablet 35d2910628774d18af9b616272b05260 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240502 01:55:27.032039 25503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35d2910628774d18af9b616272b05260. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.036967 25576 tablet_service.cc:1467] Processing CreateTablet for tablet ef2c1bf82b7f4e5f8e079a9502e236b0 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240502 01:55:27.037245 25576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef2c1bf82b7f4e5f8e079a9502e236b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.039101 25635 ts_tablet_manager.cc:1398] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.055s user 0.013s sys 0.025s
I20240502 01:55:27.039364 25467 heartbeater.cc:503] Master 127.23.192.62:43317 was elected leader, sending a full tablet report...
I20240502 01:55:27.039721 25426 tablet_service.cc:1467] Processing CreateTablet for tablet 1c0d4918f3994489a7289728ca82deff (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240502 01:55:27.042203 25640 raft_consensus.cc:482] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.044992 25635 tablet_bootstrap.cc:492] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.045300 25501 tablet_service.cc:1467] Processing CreateTablet for tablet 75bf436d41da407e8ce821896b041627 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240502 01:55:27.045328 25424 tablet_service.cc:1467] Processing CreateTablet for tablet c6adb7e9b9fa4b858ce0f42b8416cc3c (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240502 01:55:27.045607 25501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75bf436d41da407e8ce821896b041627. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.046696 25426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c0d4918f3994489a7289728ca82deff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.047230 25424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6adb7e9b9fa4b858ce0f42b8416cc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.048274 25637 tablet_bootstrap.cc:492] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.048437 25637 ts_tablet_manager.cc:1367] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.141s user 0.011s sys 0.014s
I20240502 01:55:27.042325 25640 raft_consensus.cc:504] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.055809 25640 leader_election.cc:288] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.058684 25574 tablet_service.cc:1467] Processing CreateTablet for tablet 62d013793fcb4f2a9fe28d149040f721 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240502 01:55:27.059278 25500 tablet_service.cc:1467] Processing CreateTablet for tablet 325a9997b7724b7a999511469e0cf9da (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240502 01:55:27.059664 25500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 325a9997b7724b7a999511469e0cf9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.059583 25505 tablet_service.cc:1467] Processing CreateTablet for tablet a9515b30bb98470f966aa70bdf23e721 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240502 01:55:27.059927 25505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9515b30bb98470f966aa70bdf23e721. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.060446 25574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62d013793fcb4f2a9fe28d149040f721. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.060997 25506 tablet_service.cc:1467] Processing CreateTablet for tablet 8824314ff50341f4ac45b9d16bc2e338 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240502 01:55:27.062865 25506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8824314ff50341f4ac45b9d16bc2e338. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.065099 25637 raft_consensus.cc:348] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.067343 25637 raft_consensus.cc:374] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.067468 25637 raft_consensus.cc:729] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.067775 25637 consensus_queue.cc:260] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.077971 25635 tablet_bootstrap.cc:654] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.081115 25581 tablet_service.cc:1467] Processing CreateTablet for tablet 45cdd96cf1414bf794042b2d514aa82a (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240502 01:55:27.081480 25581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45cdd96cf1414bf794042b2d514aa82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.082685 25425 tablet_service.cc:1467] Processing CreateTablet for tablet 568a8db50f33400992fff1ff0b3f9505 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240502 01:55:27.086175 25425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 568a8db50f33400992fff1ff0b3f9505. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.091353 25429 tablet_service.cc:1467] Processing CreateTablet for tablet 4fab7be12223417a873e8747bb4ce8fd (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240502 01:55:27.092890 25429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fab7be12223417a873e8747bb4ce8fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.094803 25507 tablet_service.cc:1467] Processing CreateTablet for tablet 4ddecb61ec374e229ae91cda1bfbd6c5 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240502 01:55:27.095742 25507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ddecb61ec374e229ae91cda1bfbd6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.098500 25502 tablet_service.cc:1467] Processing CreateTablet for tablet c091595af786411ab065cb62430c1f9b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240502 01:55:27.098774 25502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c091595af786411ab065cb62430c1f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.102329 25580 tablet_service.cc:1467] Processing CreateTablet for tablet 9fa192ac75ca4897be4bed9594502e7b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240502 01:55:27.102618 25580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fa192ac75ca4897be4bed9594502e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.106072 25577 tablet_service.cc:1467] Processing CreateTablet for tablet 3fafad230c13400391bdbba1ac1ee318 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240502 01:55:27.106074 25578 tablet_service.cc:1467] Processing CreateTablet for tablet 600040d630eb4fa9809d5d477c55dc41 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240502 01:55:27.106683 25577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fafad230c13400391bdbba1ac1ee318. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.106920 25503 tablet_service.cc:1467] Processing CreateTablet for tablet 4ee8b791ab244610b38e826d805bea27 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240502 01:55:27.107030 25578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 600040d630eb4fa9809d5d477c55dc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.107295 25503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ee8b791ab244610b38e826d805bea27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.109776 25505 tablet_service.cc:1467] Processing CreateTablet for tablet e139c33535c94f1aa2b444fef24038a0 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240502 01:55:27.110146 25505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e139c33535c94f1aa2b444fef24038a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.113662 25579 tablet_service.cc:1467] Processing CreateTablet for tablet 03251bf1c560469880b1ab407d24a810 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240502 01:55:27.113945 25579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03251bf1c560469880b1ab407d24a810. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.114594 25637 ts_tablet_manager.cc:1398] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.066s user 0.003s sys 0.023s
I20240502 01:55:27.114800 25616 heartbeater.cc:503] Master 127.23.192.62:43317 was elected leader, sending a full tablet report...
I20240502 01:55:27.114886 25637 tablet_bootstrap.cc:492] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.118072 25431 tablet_service.cc:1467] Processing CreateTablet for tablet feaebca58bd448eb8769581e94dd493c (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240502 01:55:27.119516 25431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet feaebca58bd448eb8769581e94dd493c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.128454 25631 ts_tablet_manager.cc:1398] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.189s user 0.013s sys 0.001s
I20240502 01:55:27.128726 25631 tablet_bootstrap.cc:492] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.129912 25631 tablet_bootstrap.cc:654] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.130051 25432 tablet_service.cc:1467] Processing CreateTablet for tablet cda8a639a1914915a2caaf8362fe2643 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240502 01:55:27.130219 25637 tablet_bootstrap.cc:654] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.130409 25432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cda8a639a1914915a2caaf8362fe2643. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.134100 25423 tablet_service.cc:1467] Processing CreateTablet for tablet fb34d5458b92443c92f78bc26f6b3804 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240502 01:55:27.134440 25423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb34d5458b92443c92f78bc26f6b3804. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.139062 25426 tablet_service.cc:1467] Processing CreateTablet for tablet 71689056867841e3aef8030fe4d2c58b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240502 01:55:27.139434 25426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71689056867841e3aef8030fe4d2c58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.140650 25575 tablet_service.cc:1467] Processing CreateTablet for tablet 47b72129270d4be3bf173be990d530f3 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240502 01:55:27.140808 25498 tablet_service.cc:1467] Processing CreateTablet for tablet 15cb657546744202be12c0972b25f8fd (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240502 01:55:27.141108 25575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47b72129270d4be3bf173be990d530f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.141175 25498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15cb657546744202be12c0972b25f8fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.144964 25430 tablet_service.cc:1467] Processing CreateTablet for tablet 15cacbe419b1480f9ea528e3a31c32f3 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240502 01:55:27.149955 25578 tablet_service.cc:1467] Processing CreateTablet for tablet 3c9855b1e8274e49a57434e6151b8e70 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240502 01:55:27.150327 25578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c9855b1e8274e49a57434e6151b8e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.153311 25505 tablet_service.cc:1467] Processing CreateTablet for tablet de09870b6fba4a19bf37028fea65f5bd (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240502 01:55:27.153684 25505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de09870b6fba4a19bf37028fea65f5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.155478 25576 tablet_service.cc:1467] Processing CreateTablet for tablet 8399bb471a684ee8880fdd9ad668fff3 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240502 01:55:27.155825 25576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8399bb471a684ee8880fdd9ad668fff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.157469 25499 tablet_service.cc:1467] Processing CreateTablet for tablet cf2b4ef78604481aa1908c93daa714f5 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240502 01:55:27.157791 25499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf2b4ef78604481aa1908c93daa714f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.157902 25425 tablet_service.cc:1467] Processing CreateTablet for tablet cb89dc94017c476aa8377bf49fd2d07b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240502 01:55:27.158104 25507 tablet_service.cc:1467] Processing CreateTablet for tablet 4fcf0c1ff88f41c681a940a3db368e1a (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240502 01:55:27.158418 25507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fcf0c1ff88f41c681a940a3db368e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.159247 25504 tablet_service.cc:1467] Processing CreateTablet for tablet b5a57f0b51324d02b9ce36a71d5dbd90 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240502 01:55:27.159343 25428 tablet_service.cc:1467] Processing CreateTablet for tablet 1721db9e2cf341f98bad0f77824788ff (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240502 01:55:27.158193 25425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb89dc94017c476aa8377bf49fd2d07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.161329 25430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15cacbe419b1480f9ea528e3a31c32f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.162017 25428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1721db9e2cf341f98bad0f77824788ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.163324 25504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5a57f0b51324d02b9ce36a71d5dbd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.165215 25426 tablet_service.cc:1467] Processing CreateTablet for tablet e04d952325064d5a9414dbefca50ce1c (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240502 01:55:27.165613 25426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e04d952325064d5a9414dbefca50ce1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.167807 25424 tablet_service.cc:1467] Processing CreateTablet for tablet 6dcf64b234454dbe8cb1ff3c2e3639d7 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240502 01:55:27.168159 25424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dcf64b234454dbe8cb1ff3c2e3639d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.169894 25427 tablet_service.cc:1467] Processing CreateTablet for tablet 35d2910628774d18af9b616272b05260 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240502 01:55:27.178512 25573 tablet_service.cc:1467] Processing CreateTablet for tablet 1c0d4918f3994489a7289728ca82deff (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240502 01:55:27.179759 25427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35d2910628774d18af9b616272b05260. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.181193 25573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c0d4918f3994489a7289728ca82deff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.182687 25577 tablet_service.cc:1467] Processing CreateTablet for tablet c6adb7e9b9fa4b858ce0f42b8416cc3c (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240502 01:55:27.183056 25577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6adb7e9b9fa4b858ce0f42b8416cc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.188773 25633 raft_consensus.cc:482] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.190078 25574 tablet_service.cc:1467] Processing CreateTablet for tablet 568a8db50f33400992fff1ff0b3f9505 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240502 01:55:27.190354 25574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 568a8db50f33400992fff1ff0b3f9505. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.188901 25633 raft_consensus.cc:504] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.203626 25432 tablet_service.cc:1467] Processing CreateTablet for tablet 75bf436d41da407e8ce821896b041627 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240502 01:55:27.203989 25432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75bf436d41da407e8ce821896b041627. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.205997 25431 tablet_service.cc:1467] Processing CreateTablet for tablet 325a9997b7724b7a999511469e0cf9da (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240502 01:55:27.206321 25431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 325a9997b7724b7a999511469e0cf9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.196610 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaabd178eb5f44ae80af982a61550119" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
W20240502 01:55:27.210654 25406 leader_election.cc:341] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.211874 25581 tablet_service.cc:1467] Processing CreateTablet for tablet 4fab7be12223417a873e8747bb4ce8fd (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240502 01:55:27.212419 25633 leader_election.cc:288] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.213840 25581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fab7be12223417a873e8747bb4ce8fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.214587 25576 tablet_service.cc:1467] Processing CreateTablet for tablet feaebca58bd448eb8769581e94dd493c (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240502 01:55:27.214916 25576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet feaebca58bd448eb8769581e94dd493c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.216657 25572 tablet_service.cc:1467] Processing CreateTablet for tablet cda8a639a1914915a2caaf8362fe2643 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240502 01:55:27.216954 25572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cda8a639a1914915a2caaf8362fe2643. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.220574 25575 tablet_service.cc:1467] Processing CreateTablet for tablet fb34d5458b92443c92f78bc26f6b3804 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240502 01:55:27.220919 25575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb34d5458b92443c92f78bc26f6b3804. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.225071 25633 raft_consensus.cc:482] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.225178 25633 raft_consensus.cc:504] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.225579 25633 leader_election.cc:288] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.230103 25631 tablet_bootstrap.cc:492] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.231235 25631 ts_tablet_manager.cc:1367] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.103s user 0.016s sys 0.011s
I20240502 01:55:27.232580 25429 tablet_service.cc:1467] Processing CreateTablet for tablet a9515b30bb98470f966aa70bdf23e721 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240502 01:55:27.235194 25635 tablet_bootstrap.cc:492] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.235319 25635 ts_tablet_manager.cc:1367] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.190s user 0.017s sys 0.016s
I20240502 01:55:27.237632 25429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9515b30bb98470f966aa70bdf23e721. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.233137 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaabd178eb5f44ae80af982a61550119" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.240929 25631 raft_consensus.cc:348] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.241115 25631 raft_consensus.cc:374] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.241183 25631 raft_consensus.cc:729] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.241401 25631 consensus_queue.cc:260] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.241989 25631 ts_tablet_manager.cc:1398] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20240502 01:55:27.242254 25631 tablet_bootstrap.cc:492] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.243593 25631 tablet_bootstrap.cc:654] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
W20240502 01:55:27.247664 25407 leader_election.cc:341] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.247779 25407 leader_election.cc:302] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.248003 25640 raft_consensus.cc:2726] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:27.248342 25428 tablet_service.cc:1467] Processing CreateTablet for tablet 8824314ff50341f4ac45b9d16bc2e338 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240502 01:55:27.249233 25428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8824314ff50341f4ac45b9d16bc2e338. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.249802 25578 tablet_service.cc:1467] Processing CreateTablet for tablet 71689056867841e3aef8030fe4d2c58b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240502 01:55:27.250147 25578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71689056867841e3aef8030fe4d2c58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.251108 25427 tablet_service.cc:1467] Processing CreateTablet for tablet 4ddecb61ec374e229ae91cda1bfbd6c5 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240502 01:55:27.251401 25427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ddecb61ec374e229ae91cda1bfbd6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.257632 25637 tablet_bootstrap.cc:492] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.257733 25637 ts_tablet_manager.cc:1367] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.143s user 0.015s sys 0.008s
I20240502 01:55:27.260205 25426 tablet_service.cc:1467] Processing CreateTablet for tablet c091595af786411ab065cb62430c1f9b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240502 01:55:27.261193 25426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c091595af786411ab065cb62430c1f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.264132 25637 raft_consensus.cc:348] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.264308 25637 raft_consensus.cc:374] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.264351 25637 raft_consensus.cc:729] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.264521 25637 consensus_queue.cc:260] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.265533 25423 tablet_service.cc:1467] Processing CreateTablet for tablet 4ee8b791ab244610b38e826d805bea27 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240502 01:55:27.267364 25580 tablet_service.cc:1467] Processing CreateTablet for tablet 15cacbe419b1480f9ea528e3a31c32f3 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240502 01:55:27.267583 25423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ee8b791ab244610b38e826d805bea27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.260757 25635 raft_consensus.cc:348] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.267805 25635 raft_consensus.cc:374] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.267894 25635 raft_consensus.cc:729] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.267836 25580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15cacbe419b1480f9ea528e3a31c32f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.269444 25635 consensus_queue.cc:260] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.270766 25637 ts_tablet_manager.cc:1398] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20240502 01:55:27.271030 25637 tablet_bootstrap.cc:492] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.271901 25635 ts_tablet_manager.cc:1398] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
I20240502 01:55:27.272087 25635 tablet_bootstrap.cc:492] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.277940 25579 tablet_service.cc:1467] Processing CreateTablet for tablet adfecdabe3c04439bddacefd7be19242 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240502 01:55:27.278218 25579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adfecdabe3c04439bddacefd7be19242. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.279104 25631 tablet_bootstrap.cc:492] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.280229 25631 ts_tablet_manager.cc:1367] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.000s
I20240502 01:55:27.282598 25432 tablet_service.cc:1467] Processing CreateTablet for tablet e139c33535c94f1aa2b444fef24038a0 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240502 01:55:27.283018 25432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e139c33535c94f1aa2b444fef24038a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.283020 25637 tablet_bootstrap.cc:654] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.286284 25424 tablet_service.cc:1467] Processing CreateTablet for tablet 15cb657546744202be12c0972b25f8fd (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240502 01:55:27.287206 25424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15cb657546744202be12c0972b25f8fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.288909 25631 raft_consensus.cc:348] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.289044 25631 raft_consensus.cc:374] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.289095 25631 raft_consensus.cc:729] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.289271 25631 consensus_queue.cc:260] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.289752 25631 ts_tablet_manager.cc:1398] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20240502 01:55:27.289981 25631 tablet_bootstrap.cc:492] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.292579 25633 raft_consensus.cc:482] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.292702 25633 raft_consensus.cc:504] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.293231 25633 leader_election.cc:288] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.295532 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f6789c3e6d44cff8e50f6a9af1a42e7" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.295776 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f04f974e1b420f904c63cf6e1baa6b" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:27.297894 25483 leader_election.cc:341] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
W20240502 01:55:27.298092 25483 leader_election.cc:341] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.299181 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "005b796aabf04ae79928bc4457a209db" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.299620 25633 raft_consensus.cc:482] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20240502 01:55:27.299975 25483 leader_election.cc:341] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.299737 25633 raft_consensus.cc:504] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.305100 25644 raft_consensus.cc:482] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.305209 25644 raft_consensus.cc:504] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.306922 25577 tablet_service.cc:1467] Processing CreateTablet for tablet cb89dc94017c476aa8377bf49fd2d07b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240502 01:55:27.305416 25431 tablet_service.cc:1467] Processing CreateTablet for tablet de09870b6fba4a19bf37028fea65f5bd (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240502 01:55:27.308099 25431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de09870b6fba4a19bf37028fea65f5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.311036 25577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb89dc94017c476aa8377bf49fd2d07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.312582 25644 leader_election.cc:288] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.312726 25574 tablet_service.cc:1467] Processing CreateTablet for tablet 1721db9e2cf341f98bad0f77824788ff (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240502 01:55:27.313103 25574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1721db9e2cf341f98bad0f77824788ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.313123 25633 leader_election.cc:288] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.313794 25581 tablet_service.cc:1467] Processing CreateTablet for tablet e04d952325064d5a9414dbefca50ce1c (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240502 01:55:27.314152 25581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e04d952325064d5a9414dbefca50ce1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.317551 25576 tablet_service.cc:1467] Processing CreateTablet for tablet 6dcf64b234454dbe8cb1ff3c2e3639d7 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240502 01:55:27.315068 25425 tablet_service.cc:1467] Processing CreateTablet for tablet cf2b4ef78604481aa1908c93daa714f5 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240502 01:55:27.318382 25425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf2b4ef78604481aa1908c93daa714f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.320233 25576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dcf64b234454dbe8cb1ff3c2e3639d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.327068 25430 tablet_service.cc:1467] Processing CreateTablet for tablet 4fcf0c1ff88f41c681a940a3db368e1a (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240502 01:55:27.327677 25430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fcf0c1ff88f41c681a940a3db368e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.330348 25635 tablet_bootstrap.cc:654] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.338232 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "005b796aabf04ae79928bc4457a209db" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.338814 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f04f974e1b420f904c63cf6e1baa6b" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.345319 25427 tablet_service.cc:1467] Processing CreateTablet for tablet b5a57f0b51324d02b9ce36a71d5dbd90 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240502 01:55:27.345660 25427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5a57f0b51324d02b9ce36a71d5dbd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.346431 25581 tablet_service.cc:1467] Processing CreateTablet for tablet 35d2910628774d18af9b616272b05260 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240502 01:55:27.346763 25581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35d2910628774d18af9b616272b05260. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.346796 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f6789c3e6d44cff8e50f6a9af1a42e7" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.347137 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02a8e17203f54aa7b857bf0768799d3b" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.349735 25573 tablet_service.cc:1467] Processing CreateTablet for tablet 8824314ff50341f4ac45b9d16bc2e338 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20240502 01:55:27.350625 25483 leader_election.cc:341] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.350800 25483 leader_election.cc:302] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9; no voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.350816 25575 tablet_service.cc:1467] Processing CreateTablet for tablet 75bf436d41da407e8ce821896b041627 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240502 01:55:27.351147 25633 raft_consensus.cc:2726] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:27.351902 25573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8824314ff50341f4ac45b9d16bc2e338. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.352295 25575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75bf436d41da407e8ce821896b041627. 1 dirs total, 0 dirs full, 0 dirs failed
W20240502 01:55:27.352797 25483 leader_election.cc:341] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.352898 25483 leader_election.cc:302] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9; no voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.353118 25633 raft_consensus.cc:2726] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20240502 01:55:27.353224 25483 leader_election.cc:341] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.353317 25483 leader_election.cc:302] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9; no voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.353503 25633 raft_consensus.cc:2726] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20240502 01:55:27.353837 25483 leader_election.cc:341] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.355731 25580 tablet_service.cc:1467] Processing CreateTablet for tablet 325a9997b7724b7a999511469e0cf9da (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240502 01:55:27.356047 25580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 325a9997b7724b7a999511469e0cf9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.356868 25577 tablet_service.cc:1467] Processing CreateTablet for tablet a9515b30bb98470f966aa70bdf23e721 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240502 01:55:27.358094 25577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9515b30bb98470f966aa70bdf23e721. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.362043 25631 tablet_bootstrap.cc:654] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.362680 25579 tablet_service.cc:1467] Processing CreateTablet for tablet 4ddecb61ec374e229ae91cda1bfbd6c5 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240502 01:55:27.362818 25578 tablet_service.cc:1467] Processing CreateTablet for tablet c091595af786411ab065cb62430c1f9b (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240502 01:55:27.363195 25578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c091595af786411ab065cb62430c1f9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.365034 25637 tablet_bootstrap.cc:492] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.365173 25637 ts_tablet_manager.cc:1367] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.094s user 0.027s sys 0.016s
I20240502 01:55:27.366266 25579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ddecb61ec374e229ae91cda1bfbd6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.367069 25572 tablet_service.cc:1467] Processing CreateTablet for tablet 4ee8b791ab244610b38e826d805bea27 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240502 01:55:27.368834 25572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ee8b791ab244610b38e826d805bea27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.370007 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02a8e17203f54aa7b857bf0768799d3b" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.370195 25591 raft_consensus.cc:2454] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:27.370534 25483 leader_election.cc:302] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f
I20240502 01:55:27.370723 25633 raft_consensus.cc:2781] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.370783 25633 raft_consensus.cc:482] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.370873 25633 raft_consensus.cc:3037] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.376567 25637 raft_consensus.cc:348] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.376678 25581 tablet_service.cc:1467] Processing CreateTablet for tablet e139c33535c94f1aa2b444fef24038a0 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240502 01:55:27.376744 25637 raft_consensus.cc:374] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.376917 25637 raft_consensus.cc:729] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.377019 25581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e139c33535c94f1aa2b444fef24038a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.377146 25637 consensus_queue.cc:260] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.378154 25637 ts_tablet_manager.cc:1398] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20240502 01:55:27.378413 25637 tablet_bootstrap.cc:492] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.380560 25633 raft_consensus.cc:504] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.381032 25633 leader_election.cc:288] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.381362 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02a8e17203f54aa7b857bf0768799d3b" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.381408 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02a8e17203f54aa7b857bf0768799d3b" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:27.381554 25591 raft_consensus.cc:3037] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
W20240502 01:55:27.382577 25483 leader_election.cc:341] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.384059 25574 tablet_service.cc:1467] Processing CreateTablet for tablet 15cb657546744202be12c0972b25f8fd (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240502 01:55:27.384356 25574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15cb657546744202be12c0972b25f8fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.391368 25635 tablet_bootstrap.cc:492] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.391487 25635 ts_tablet_manager.cc:1367] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.119s user 0.010s sys 0.004s
I20240502 01:55:27.391710 25577 tablet_service.cc:1467] Processing CreateTablet for tablet de09870b6fba4a19bf37028fea65f5bd (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240502 01:55:27.391750 25576 tablet_service.cc:1467] Processing CreateTablet for tablet cf2b4ef78604481aa1908c93daa714f5 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240502 01:55:27.392222 25591 raft_consensus.cc:2454] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:27.392616 25483 leader_election.cc:302] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f
I20240502 01:55:27.392684 25576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf2b4ef78604481aa1908c93daa714f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.392851 25633 raft_consensus.cc:2781] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.393410 25577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de09870b6fba4a19bf37028fea65f5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.394977 25578 tablet_service.cc:1467] Processing CreateTablet for tablet 4fcf0c1ff88f41c681a940a3db368e1a (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240502 01:55:27.395256 25578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fcf0c1ff88f41c681a940a3db368e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.401917 25573 tablet_service.cc:1467] Processing CreateTablet for tablet b5a57f0b51324d02b9ce36a71d5dbd90 (DEFAULT_TABLE table=test-workload [id=7946016b2fba4afc9a804f19dfe3daad]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240502 01:55:27.402266 25573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5a57f0b51324d02b9ce36a71d5dbd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:27.405414 25635 raft_consensus.cc:348] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.405612 25635 raft_consensus.cc:374] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.405665 25635 raft_consensus.cc:729] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.409502 25637 tablet_bootstrap.cc:654] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.410157 25635 consensus_queue.cc:260] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.410660 25635 ts_tablet_manager.cc:1398] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20240502 01:55:27.411044 25635 tablet_bootstrap.cc:492] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.409878 25633 raft_consensus.cc:686] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:27.415421 25633 consensus_queue.cc:237] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.422201 25635 tablet_bootstrap.cc:654] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.422365 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f960dc60ff5402d8db16edd5ab3cb2d" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
W20240502 01:55:27.422791 25557 leader_election.cc:341] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.425832 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f960dc60ff5402d8db16edd5ab3cb2d" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.425928 25339 catalog_manager.cc:5484] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
W20240502 01:55:27.426260 25556 leader_election.cc:341] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.426360 25556 leader_election.cc:302] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:27.426560 25644 raft_consensus.cc:2726] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:27.431427 25631 tablet_bootstrap.cc:492] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.431561 25631 ts_tablet_manager.cc:1367] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.142s user 0.011s sys 0.016s
I20240502 01:55:27.432243 25631 raft_consensus.cc:348] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.432433 25631 raft_consensus.cc:374] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.432502 25631 raft_consensus.cc:729] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.432670 25635 tablet_bootstrap.cc:492] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.432790 25635 ts_tablet_manager.cc:1367] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.001s
I20240502 01:55:27.432723 25631 consensus_queue.cc:260] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.433246 25631 ts_tablet_manager.cc:1398] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:27.434880 25631 tablet_bootstrap.cc:492] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.435000 25635 raft_consensus.cc:348] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.435160 25635 raft_consensus.cc:374] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.435218 25635 raft_consensus.cc:729] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.435417 25635 consensus_queue.cc:260] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.436784 25635 ts_tablet_manager.cc:1398] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:55:27.437054 25635 tablet_bootstrap.cc:492] T 082a20c28ee243268963c85be001faa7 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.446269 25635 tablet_bootstrap.cc:654] T 082a20c28ee243268963c85be001faa7 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
W20240502 01:55:27.451696 25387 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 01:55:27.454573 25631 tablet_bootstrap.cc:654] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.455135 25637 tablet_bootstrap.cc:492] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.455281 25637 ts_tablet_manager.cc:1367] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.077s user 0.009s sys 0.013s
I20240502 01:55:27.456370 25633 raft_consensus.cc:482] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.456250 25637 raft_consensus.cc:348] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.456504 25633 raft_consensus.cc:504] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.456607 25637 raft_consensus.cc:374] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.456737 25637 raft_consensus.cc:729] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.456943 25637 consensus_queue.cc:260] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.457885 25633 leader_election.cc:288] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.458384 25637 ts_tablet_manager.cc:1398] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240502 01:55:27.458706 25637 tablet_bootstrap.cc:492] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.459159 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaabd178eb5f44ae80af982a61550119" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.459347 25441 raft_consensus.cc:2454] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:27.459705 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaabd178eb5f44ae80af982a61550119" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:27.460202 25483 leader_election.cc:341] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.460407 25483 leader_election.cc:302] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.460811 25633 raft_consensus.cc:2781] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.460896 25633 raft_consensus.cc:482] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.460963 25633 raft_consensus.cc:3037] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.462275 25635 tablet_bootstrap.cc:492] T 082a20c28ee243268963c85be001faa7 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.462412 25635 ts_tablet_manager.cc:1367] T 082a20c28ee243268963c85be001faa7 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.004s
I20240502 01:55:27.463130 25635 raft_consensus.cc:348] T 082a20c28ee243268963c85be001faa7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.463304 25635 raft_consensus.cc:374] T 082a20c28ee243268963c85be001faa7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.463357 25635 raft_consensus.cc:729] T 082a20c28ee243268963c85be001faa7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.463390 25637 tablet_bootstrap.cc:654] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.463527 25635 consensus_queue.cc:260] T 082a20c28ee243268963c85be001faa7 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.463999 25635 ts_tablet_manager.cc:1398] T 082a20c28ee243268963c85be001faa7 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:27.464253 25635 tablet_bootstrap.cc:492] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.464216 25633 raft_consensus.cc:504] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.464222 25640 raft_consensus.cc:482] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.464697 25640 raft_consensus.cc:504] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.464797 25633 leader_election.cc:288] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.465284 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaabd178eb5f44ae80af982a61550119" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.465452 25441 raft_consensus.cc:3037] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.465699 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc6480138d14df397ca2db53ca652d2" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.465831 25635 tablet_bootstrap.cc:654] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.466306 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc6480138d14df397ca2db53ca652d2" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:27.466755 25406 leader_election.cc:341] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
W20240502 01:55:27.467087 25407 leader_election.cc:341] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.467196 25407 leader_election.cc:302] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.467439 25641 raft_consensus.cc:2726] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:27.465296 25640 leader_election.cc:288] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.468096 25441 raft_consensus.cc:2454] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:27.468389 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaabd178eb5f44ae80af982a61550119" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:27.468925 25483 leader_election.cc:302] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
W20240502 01:55:27.469168 25483 leader_election.cc:341] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.469435 25633 raft_consensus.cc:2781] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.469563 25633 raft_consensus.cc:686] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:27.469782 25633 consensus_queue.cc:237] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.473169 25631 tablet_bootstrap.cc:492] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.473291 25631 ts_tablet_manager.cc:1367] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20240502 01:55:27.473860 25635 tablet_bootstrap.cc:492] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.474017 25635 ts_tablet_manager.cc:1367] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20240502 01:55:27.473881 25631 raft_consensus.cc:348] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.474117 25631 raft_consensus.cc:374] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.474196 25631 raft_consensus.cc:729] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.474112 25339 catalog_manager.cc:5484] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:27.474396 25631 consensus_queue.cc:260] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.474674 25635 raft_consensus.cc:348] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.474897 25635 raft_consensus.cc:374] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.474983 25635 raft_consensus.cc:729] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.475179 25631 ts_tablet_manager.cc:1398] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:27.475190 25635 consensus_queue.cc:260] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.475409 25631 tablet_bootstrap.cc:492] T 082a20c28ee243268963c85be001faa7 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.475652 25635 ts_tablet_manager.cc:1398] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:27.475946 25635 tablet_bootstrap.cc:492] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.476786 25631 tablet_bootstrap.cc:654] T 082a20c28ee243268963c85be001faa7 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.477510 25635 tablet_bootstrap.cc:654] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.481509 25637 tablet_bootstrap.cc:492] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.481595 25640 raft_consensus.cc:482] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.481675 25637 ts_tablet_manager.cc:1367] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.001s
I20240502 01:55:27.481750 25640 raft_consensus.cc:504] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.482321 25640 leader_election.cc:288] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.482584 25637 raft_consensus.cc:348] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.482954 25637 raft_consensus.cc:374] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.482931 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40e8e94fa76d49eebe0a9572ff2b3f12" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.483129 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40e8e94fa76d49eebe0a9572ff2b3f12" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.483302 25517 raft_consensus.cc:2454] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
W20240502 01:55:27.483350 25407 leader_election.cc:341] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.483078 25637 raft_consensus.cc:729] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.483687 25406 leader_election.cc:302] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.484035 25640 raft_consensus.cc:2781] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.484118 25640 raft_consensus.cc:482] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.484202 25640 raft_consensus.cc:3037] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.485158 25631 tablet_bootstrap.cc:492] T 082a20c28ee243268963c85be001faa7 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.485282 25631 ts_tablet_manager.cc:1367] T 082a20c28ee243268963c85be001faa7 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20240502 01:55:27.485852 25631 raft_consensus.cc:348] T 082a20c28ee243268963c85be001faa7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.486037 25631 raft_consensus.cc:374] T 082a20c28ee243268963c85be001faa7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.486091 25631 raft_consensus.cc:729] T 082a20c28ee243268963c85be001faa7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.486290 25631 consensus_queue.cc:260] T 082a20c28ee243268963c85be001faa7 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.483963 25637 consensus_queue.cc:260] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.486846 25631 ts_tablet_manager.cc:1398] T 082a20c28ee243268963c85be001faa7 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 01:55:27.486809 25640 raft_consensus.cc:504] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.487107 25631 tablet_bootstrap.cc:492] T 34fff5148ef24f36b798374c1bfc6f69 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.487166 25637 ts_tablet_manager.cc:1398] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:55:27.487401 25637 tablet_bootstrap.cc:492] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.487756 25640 leader_election.cc:288] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.486783 25635 tablet_bootstrap.cc:492] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.487952 25635 ts_tablet_manager.cc:1367] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.001s
I20240502 01:55:27.487959 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40e8e94fa76d49eebe0a9572ff2b3f12" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:27.488387 25407 leader_election.cc:341] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.488843 25635 raft_consensus.cc:348] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.488987 25631 tablet_bootstrap.cc:654] T 34fff5148ef24f36b798374c1bfc6f69 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.489009 25635 raft_consensus.cc:374] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.489059 25635 raft_consensus.cc:729] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.489223 25635 consensus_queue.cc:260] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.489768 25635 ts_tablet_manager.cc:1398] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:55:27.489934 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40e8e94fa76d49eebe0a9572ff2b3f12" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.490013 25635 tablet_bootstrap.cc:492] T 34fff5148ef24f36b798374c1bfc6f69 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.490073 25517 raft_consensus.cc:3037] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.490657 25637 tablet_bootstrap.cc:654] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.492425 25635 tablet_bootstrap.cc:654] T 34fff5148ef24f36b798374c1bfc6f69 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.495523 25517 raft_consensus.cc:2454] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:27.495831 25406 leader_election.cc:302] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.496033 25640 raft_consensus.cc:2781] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.496436 25640 raft_consensus.cc:686] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:27.496686 25640 consensus_queue.cc:237] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.497347 25631 tablet_bootstrap.cc:492] T 34fff5148ef24f36b798374c1bfc6f69 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.497520 25631 ts_tablet_manager.cc:1367] T 34fff5148ef24f36b798374c1bfc6f69 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20240502 01:55:27.498200 25631 raft_consensus.cc:348] T 34fff5148ef24f36b798374c1bfc6f69 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.498420 25631 raft_consensus.cc:374] T 34fff5148ef24f36b798374c1bfc6f69 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.498493 25637 tablet_bootstrap.cc:492] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.498523 25631 raft_consensus.cc:729] T 34fff5148ef24f36b798374c1bfc6f69 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.498610 25637 ts_tablet_manager.cc:1367] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.001s
I20240502 01:55:27.498891 25631 consensus_queue.cc:260] T 34fff5148ef24f36b798374c1bfc6f69 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.499233 25637 raft_consensus.cc:348] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.499392 25339 catalog_manager.cc:5484] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:27.499390 25637 raft_consensus.cc:374] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.500290 25631 ts_tablet_manager.cc:1398] T 34fff5148ef24f36b798374c1bfc6f69 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:55:27.500388 25637 raft_consensus.cc:729] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.500669 25637 consensus_queue.cc:260] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.501178 25637 ts_tablet_manager.cc:1398] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:27.501488 25631 tablet_bootstrap.cc:492] T 0f960dc60ff5402d8db16edd5ab3cb2d P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.501825 25637 tablet_bootstrap.cc:492] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.503036 25631 tablet_bootstrap.cc:654] T 0f960dc60ff5402d8db16edd5ab3cb2d P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.503142 25637 tablet_bootstrap.cc:654] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.504056 25635 tablet_bootstrap.cc:492] T 34fff5148ef24f36b798374c1bfc6f69 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.504199 25635 ts_tablet_manager.cc:1367] T 34fff5148ef24f36b798374c1bfc6f69 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20240502 01:55:27.504859 25635 raft_consensus.cc:348] T 34fff5148ef24f36b798374c1bfc6f69 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.505041 25635 raft_consensus.cc:374] T 34fff5148ef24f36b798374c1bfc6f69 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.505103 25635 raft_consensus.cc:729] T 34fff5148ef24f36b798374c1bfc6f69 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.505314 25635 consensus_queue.cc:260] T 34fff5148ef24f36b798374c1bfc6f69 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.506649 25635 ts_tablet_manager.cc:1398] T 34fff5148ef24f36b798374c1bfc6f69 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:27.506934 25635 tablet_bootstrap.cc:492] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.508486 25635 tablet_bootstrap.cc:654] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.511765 25631 tablet_bootstrap.cc:492] T 0f960dc60ff5402d8db16edd5ab3cb2d P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.511799 25635 tablet_bootstrap.cc:492] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.511875 25631 ts_tablet_manager.cc:1367] T 0f960dc60ff5402d8db16edd5ab3cb2d P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20240502 01:55:27.511909 25635 ts_tablet_manager.cc:1367] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20240502 01:55:27.512056 25637 tablet_bootstrap.cc:492] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.512157 25637 ts_tablet_manager.cc:1367] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20240502 01:55:27.512444 25631 raft_consensus.cc:348] T 0f960dc60ff5402d8db16edd5ab3cb2d P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.512573 25631 raft_consensus.cc:374] T 0f960dc60ff5402d8db16edd5ab3cb2d P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.512631 25631 raft_consensus.cc:729] T 0f960dc60ff5402d8db16edd5ab3cb2d P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.512522 25635 raft_consensus.cc:348] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.512704 25635 raft_consensus.cc:374] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.512794 25635 raft_consensus.cc:729] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.512715 25637 raft_consensus.cc:348] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.512817 25631 consensus_queue.cc:260] T 0f960dc60ff5402d8db16edd5ab3cb2d P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.512929 25637 raft_consensus.cc:374] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.512979 25637 raft_consensus.cc:729] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.513013 25635 consensus_queue.cc:260] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.513141 25637 consensus_queue.cc:260] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.513602 25635 ts_tablet_manager.cc:1398] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:27.513831 25635 tablet_bootstrap.cc:492] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.514621 25644 raft_consensus.cc:482] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.514734 25644 raft_consensus.cc:504] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.514927 25631 ts_tablet_manager.cc:1398] T 0f960dc60ff5402d8db16edd5ab3cb2d P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:55:27.515285 25635 tablet_bootstrap.cc:654] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.515667 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "005b796aabf04ae79928bc4457a209db" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.515820 25637 ts_tablet_manager.cc:1398] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 01:55:27.515841 25517 raft_consensus.cc:2454] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.516197 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "005b796aabf04ae79928bc4457a209db" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.516463 25556 leader_election.cc:302] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
W20240502 01:55:27.516620 25557 leader_election.cc:341] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.517652 25637 tablet_bootstrap.cc:492] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.515300 25644 leader_election.cc:288] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.518318 25644 raft_consensus.cc:2781] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.518383 25644 raft_consensus.cc:482] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.518450 25644 raft_consensus.cc:3037] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.518610 25631 tablet_bootstrap.cc:492] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.519230 25637 tablet_bootstrap.cc:654] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.520063 25631 tablet_bootstrap.cc:654] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.521081 25644 raft_consensus.cc:504] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.521957 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "005b796aabf04ae79928bc4457a209db" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
W20240502 01:55:27.522368 25557 leader_election.cc:341] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.523344 25631 tablet_bootstrap.cc:492] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.523458 25631 ts_tablet_manager.cc:1367] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20240502 01:55:27.524101 25631 raft_consensus.cc:348] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.524266 25631 raft_consensus.cc:374] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.524312 25631 raft_consensus.cc:729] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.524509 25631 consensus_queue.cc:260] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.524919 25644 leader_election.cc:288] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.527027 25644 raft_consensus.cc:482] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.527200 25644 raft_consensus.cc:504] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.528029 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaabd178eb5f44ae80af982a61550119" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.528131 25635 tablet_bootstrap.cc:492] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.528234 25635 ts_tablet_manager.cc:1367] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.007s
I20240502 01:55:27.528234 25441 raft_consensus.cc:2379] T eaabd178eb5f44ae80af982a61550119 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 77c36b03bf7c42a9a430cc595953aff9 in this term.
I20240502 01:55:27.528364 25644 leader_election.cc:288] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.528853 25637 tablet_bootstrap.cc:492] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.529032 25637 ts_tablet_manager.cc:1367] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.011s user 0.011s sys 0.000s
I20240502 01:55:27.528962 25635 raft_consensus.cc:348] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.529166 25635 raft_consensus.cc:374] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.529229 25635 raft_consensus.cc:729] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.529423 25635 consensus_queue.cc:260] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.529868 25635 ts_tablet_manager.cc:1398] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:27.529834 25637 raft_consensus.cc:348] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.530123 25637 raft_consensus.cc:374] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.530174 25635 tablet_bootstrap.cc:492] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.530239 25637 raft_consensus.cc:729] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.530555 25637 consensus_queue.cc:260] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.527091 25631 ts_tablet_manager.cc:1398] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 01:55:27.531060 25631 tablet_bootstrap.cc:492] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.531272 25637 ts_tablet_manager.cc:1398] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:27.531563 25637 tablet_bootstrap.cc:492] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.532485 25631 tablet_bootstrap.cc:654] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.533195 25637 tablet_bootstrap.cc:654] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.534219 25635 tablet_bootstrap.cc:654] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.535755 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "005b796aabf04ae79928bc4457a209db" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.535910 25517 raft_consensus.cc:3037] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.538463 25517 raft_consensus.cc:2454] T 005b796aabf04ae79928bc4457a209db P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.538558 25631 tablet_bootstrap.cc:492] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.538652 25631 ts_tablet_manager.cc:1367] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20240502 01:55:27.539129 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaabd178eb5f44ae80af982a61550119" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.539392 25635 tablet_bootstrap.cc:492] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.539599 25635 ts_tablet_manager.cc:1367] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.005s
I20240502 01:55:27.539327 25631 raft_consensus.cc:348] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.539640 25556 leader_election.cc:302] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f
I20240502 01:55:27.539732 25631 raft_consensus.cc:374] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.539808 25631 raft_consensus.cc:729] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.540098 25680 raft_consensus.cc:2781] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.540031 25631 consensus_queue.cc:260] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.540246 25680 raft_consensus.cc:686] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:27.540503 25631 ts_tablet_manager.cc:1398] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:27.540043 25556 leader_election.cc:302] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:27.540539 25680 consensus_queue.cc:237] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.540841 25644 raft_consensus.cc:3037] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.540668 25635 raft_consensus.cc:348] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.541061 25635 raft_consensus.cc:374] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.541119 25637 tablet_bootstrap.cc:492] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.541317 25637 ts_tablet_manager.cc:1367] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.001s
I20240502 01:55:27.541309 25635 raft_consensus.cc:729] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.541683 25635 consensus_queue.cc:260] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.542007 25637 raft_consensus.cc:348] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.542200 25637 raft_consensus.cc:374] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.542308 25637 raft_consensus.cc:729] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.542557 25637 consensus_queue.cc:260] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.543673 25644 raft_consensus.cc:2726] T eaabd178eb5f44ae80af982a61550119 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:27.544955 25631 tablet_bootstrap.cc:492] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.546468 25637 ts_tablet_manager.cc:1398] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20240502 01:55:27.546547 25631 tablet_bootstrap.cc:654] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.546818 25637 tablet_bootstrap.cc:492] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.548420 25635 ts_tablet_manager.cc:1398] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240502 01:55:27.550907 25635 tablet_bootstrap.cc:492] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.552470 25635 tablet_bootstrap.cc:654] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.552500 25637 tablet_bootstrap.cc:654] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.554348 25687 raft_consensus.cc:482] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.554618 25687 raft_consensus.cc:504] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.556016 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f04f974e1b420f904c63cf6e1baa6b" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.556243 25517 raft_consensus.cc:2454] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.556617 25556 leader_election.cc:302] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.556926 25644 raft_consensus.cc:2781] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.557045 25644 raft_consensus.cc:482] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.557140 25644 raft_consensus.cc:3037] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.560017 25644 raft_consensus.cc:504] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.561010 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f04f974e1b420f904c63cf6e1baa6b" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.561203 25517 raft_consensus.cc:3037] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.564121 25517 raft_consensus.cc:2454] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.564630 25556 leader_election.cc:302] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.565094 25644 leader_election.cc:288] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851)
I20240502 01:55:27.565281 25644 raft_consensus.cc:2781] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.565407 25644 raft_consensus.cc:686] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:27.565477 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f04f974e1b420f904c63cf6e1baa6b" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.565722 25441 raft_consensus.cc:3037] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.565691 25644 consensus_queue.cc:237] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.568610 25441 raft_consensus.cc:2454] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.575217 25687 leader_election.cc:288] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851)
I20240502 01:55:27.575626 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f04f974e1b420f904c63cf6e1baa6b" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.575845 25441 raft_consensus.cc:2362] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1. Re-sending same reply.
I20240502 01:55:27.580298 25339 catalog_manager.cc:5484] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:27.589251 25339 catalog_manager.cc:5484] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:27.594941 25637 tablet_bootstrap.cc:492] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.595119 25637 ts_tablet_manager.cc:1367] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.048s user 0.009s sys 0.004s
I20240502 01:55:27.595258 25631 tablet_bootstrap.cc:492] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.595402 25631 ts_tablet_manager.cc:1367] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.051s user 0.017s sys 0.032s
I20240502 01:55:27.595852 25635 tablet_bootstrap.cc:492] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.595932 25631 raft_consensus.cc:348] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.595940 25637 raft_consensus.cc:348] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.596088 25635 ts_tablet_manager.cc:1367] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.045s user 0.023s sys 0.020s
I20240502 01:55:27.596132 25631 raft_consensus.cc:374] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.596230 25637 raft_consensus.cc:374] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.596360 25631 raft_consensus.cc:729] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.596385 25637 raft_consensus.cc:729] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.596604 25631 consensus_queue.cc:260] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.596652 25637 consensus_queue.cc:260] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.597137 25631 ts_tablet_manager.cc:1398] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:55:27.597247 25637 ts_tablet_manager.cc:1398] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:27.597498 25631 tablet_bootstrap.cc:492] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.597550 25637 tablet_bootstrap.cc:492] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.596864 25635 raft_consensus.cc:348] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.598003 25635 raft_consensus.cc:374] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.598091 25635 raft_consensus.cc:729] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.598356 25635 consensus_queue.cc:260] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.599169 25637 tablet_bootstrap.cc:654] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.600207 25631 tablet_bootstrap.cc:654] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.602432 25635 ts_tablet_manager.cc:1398] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240502 01:55:27.602774 25635 tablet_bootstrap.cc:492] T 005b796aabf04ae79928bc4457a209db P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.604434 25635 tablet_bootstrap.cc:654] T 005b796aabf04ae79928bc4457a209db P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.608029 25635 tablet_bootstrap.cc:492] T 005b796aabf04ae79928bc4457a209db P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.608180 25637 tablet_bootstrap.cc:492] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.608189 25635 ts_tablet_manager.cc:1367] T 005b796aabf04ae79928bc4457a209db P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20240502 01:55:27.608322 25637 ts_tablet_manager.cc:1367] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20240502 01:55:27.608701 25631 tablet_bootstrap.cc:492] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.608884 25631 ts_tablet_manager.cc:1367] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20240502 01:55:27.608922 25637 raft_consensus.cc:348] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.608958 25635 raft_consensus.cc:348] T 005b796aabf04ae79928bc4457a209db P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.609123 25637 raft_consensus.cc:374] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.609154 25635 raft_consensus.cc:374] T 005b796aabf04ae79928bc4457a209db P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.609251 25637 raft_consensus.cc:729] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.609278 25635 raft_consensus.cc:729] T 005b796aabf04ae79928bc4457a209db P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.609495 25637 consensus_queue.cc:260] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.609515 25635 consensus_queue.cc:260] T 005b796aabf04ae79928bc4457a209db P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.610000 25637 ts_tablet_manager.cc:1398] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:27.610095 25635 ts_tablet_manager.cc:1398] T 005b796aabf04ae79928bc4457a209db P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:55:27.610303 25637 tablet_bootstrap.cc:492] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.610388 25635 tablet_bootstrap.cc:492] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.609632 25631 raft_consensus.cc:348] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.612450 25631 raft_consensus.cc:374] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.612527 25635 tablet_bootstrap.cc:654] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.612565 25631 raft_consensus.cc:729] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.612814 25631 consensus_queue.cc:260] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.613389 25631 ts_tablet_manager.cc:1398] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 01:55:27.613406 25637 tablet_bootstrap.cc:654] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.614459 25631 tablet_bootstrap.cc:492] T a07dbbae54d745d49344fbaa9fe89f75 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.615999 25631 tablet_bootstrap.cc:654] T a07dbbae54d745d49344fbaa9fe89f75 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.618249 25635 tablet_bootstrap.cc:492] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.618445 25635 ts_tablet_manager.cc:1367] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20240502 01:55:27.619325 25635 raft_consensus.cc:348] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.619581 25635 raft_consensus.cc:374] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.619684 25631 tablet_bootstrap.cc:492] T a07dbbae54d745d49344fbaa9fe89f75 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.619686 25635 raft_consensus.cc:729] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.619874 25637 tablet_bootstrap.cc:492] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.619876 25631 ts_tablet_manager.cc:1367] T a07dbbae54d745d49344fbaa9fe89f75 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:55:27.620069 25637 ts_tablet_manager.cc:1367] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20240502 01:55:27.619968 25635 consensus_queue.cc:260] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.620935 25635 ts_tablet_manager.cc:1398] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:27.621031 25637 raft_consensus.cc:348] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.621258 25637 raft_consensus.cc:374] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.621269 25635 tablet_bootstrap.cc:492] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.621366 25637 raft_consensus.cc:729] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.621585 25637 consensus_queue.cc:260] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.622051 25637 ts_tablet_manager.cc:1398] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:27.622414 25637 tablet_bootstrap.cc:492] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.622963 25635 tablet_bootstrap.cc:654] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.623986 25637 tablet_bootstrap.cc:654] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.625682 25631 raft_consensus.cc:348] T a07dbbae54d745d49344fbaa9fe89f75 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.625890 25631 raft_consensus.cc:374] T a07dbbae54d745d49344fbaa9fe89f75 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.625983 25631 raft_consensus.cc:729] T a07dbbae54d745d49344fbaa9fe89f75 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.626181 25631 consensus_queue.cc:260] T a07dbbae54d745d49344fbaa9fe89f75 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.627465 25631 ts_tablet_manager.cc:1398] T a07dbbae54d745d49344fbaa9fe89f75 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20240502 01:55:27.627518 25637 tablet_bootstrap.cc:492] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.627655 25637 ts_tablet_manager.cc:1367] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:55:27.627794 25631 tablet_bootstrap.cc:492] T e0276f38a2d94696b6387faa09120883 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.628376 25637 raft_consensus.cc:348] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.628569 25637 raft_consensus.cc:374] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.628679 25637 raft_consensus.cc:729] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.628930 25637 consensus_queue.cc:260] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.629432 25631 tablet_bootstrap.cc:654] T e0276f38a2d94696b6387faa09120883 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.631309 25637 ts_tablet_manager.cc:1398] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 01:55:27.631644 25637 tablet_bootstrap.cc:492] T e0276f38a2d94696b6387faa09120883 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.632071 25635 tablet_bootstrap.cc:492] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.632228 25635 ts_tablet_manager.cc:1367] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20240502 01:55:27.632974 25635 raft_consensus.cc:348] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.633184 25635 raft_consensus.cc:374] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.633210 25637 tablet_bootstrap.cc:654] T e0276f38a2d94696b6387faa09120883 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.633287 25635 raft_consensus.cc:729] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.633549 25635 consensus_queue.cc:260] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.634143 25635 ts_tablet_manager.cc:1398] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:27.634445 25635 tablet_bootstrap.cc:492] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.635165 25637 tablet_bootstrap.cc:492] T e0276f38a2d94696b6387faa09120883 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.635340 25637 ts_tablet_manager.cc:1367] T e0276f38a2d94696b6387faa09120883 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20240502 01:55:27.635802 25644 raft_consensus.cc:482] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.635998 25644 raft_consensus.cc:504] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.636147 25635 tablet_bootstrap.cc:654] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.636574 25644 leader_election.cc:288] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.636941 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b90778aac3294e6c913dfe12245b17e1" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.637140 25441 raft_consensus.cc:2454] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.637554 25557 leader_election.cc:302] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.637866 25644 raft_consensus.cc:2781] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.637997 25644 raft_consensus.cc:482] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.637930 25637 raft_consensus.cc:348] T e0276f38a2d94696b6387faa09120883 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.638118 25644 raft_consensus.cc:3037] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.638149 25637 raft_consensus.cc:374] T e0276f38a2d94696b6387faa09120883 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.638228 25637 raft_consensus.cc:729] T e0276f38a2d94696b6387faa09120883 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.638458 25637 consensus_queue.cc:260] T e0276f38a2d94696b6387faa09120883 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.638972 25637 ts_tablet_manager.cc:1398] T e0276f38a2d94696b6387faa09120883 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:55:27.641209 25644 raft_consensus.cc:504] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.641741 25635 tablet_bootstrap.cc:492] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.641855 25635 ts_tablet_manager.cc:1367] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20240502 01:55:27.637883 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b90778aac3294e6c913dfe12245b17e1" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.642169 25517 raft_consensus.cc:2454] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.642195 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b90778aac3294e6c913dfe12245b17e1" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.642340 25516 raft_consensus.cc:3037] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.642431 25640 raft_consensus.cc:482] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.642524 25640 raft_consensus.cc:504] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.642813 25637 tablet_bootstrap.cc:492] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.643100 25640 leader_election.cc:288] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.643642 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f960dc60ff5402d8db16edd5ab3cb2d" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.643802 25517 raft_consensus.cc:2454] T 0f960dc60ff5402d8db16edd5ab3cb2d P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:27.644133 25406 leader_election.cc:302] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:27.644207 25637 tablet_bootstrap.cc:654] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.644697 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f960dc60ff5402d8db16edd5ab3cb2d" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.644850 25591 raft_consensus.cc:2454] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:27.645206 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b90778aac3294e6c913dfe12245b17e1" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.645364 25441 raft_consensus.cc:3037] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.646013 25635 raft_consensus.cc:348] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.646178 25635 raft_consensus.cc:374] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.646231 25635 raft_consensus.cc:729] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.646438 25635 consensus_queue.cc:260] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.646692 25641 raft_consensus.cc:2781] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.646760 25641 raft_consensus.cc:482] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.646852 25641 raft_consensus.cc:3037] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.648006 25441 raft_consensus.cc:2454] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.648490 25557 leader_election.cc:302] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.648730 25691 raft_consensus.cc:2781] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.648872 25691 raft_consensus.cc:686] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:27.645385 25516 raft_consensus.cc:2454] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.649184 25644 leader_election.cc:288] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.649124 25691 consensus_queue.cc:237] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.649296 25641 raft_consensus.cc:504] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.649838 25641 leader_election.cc:288] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.650110 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f960dc60ff5402d8db16edd5ab3cb2d" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.650249 25516 raft_consensus.cc:3037] T 0f960dc60ff5402d8db16edd5ab3cb2d P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.650903 25635 ts_tablet_manager.cc:1398] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240502 01:55:27.651130 25635 tablet_bootstrap.cc:492] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.651335 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f960dc60ff5402d8db16edd5ab3cb2d" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:27.651494 25591 raft_consensus.cc:3037] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.652539 25635 tablet_bootstrap.cc:654] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.652617 25516 raft_consensus.cc:2454] T 0f960dc60ff5402d8db16edd5ab3cb2d P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:27.652961 25406 leader_election.cc:302] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:27.653208 25641 raft_consensus.cc:2781] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.653307 25641 raft_consensus.cc:686] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:27.653527 25641 consensus_queue.cc:237] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.653944 25631 tablet_bootstrap.cc:492] T e0276f38a2d94696b6387faa09120883 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.654052 25631 ts_tablet_manager.cc:1367] T e0276f38a2d94696b6387faa09120883 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.009s
I20240502 01:55:27.654098 25591 raft_consensus.cc:2454] T 0f960dc60ff5402d8db16edd5ab3cb2d P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:27.654842 25631 raft_consensus.cc:348] T e0276f38a2d94696b6387faa09120883 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.655040 25631 raft_consensus.cc:374] T e0276f38a2d94696b6387faa09120883 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.655092 25631 raft_consensus.cc:729] T e0276f38a2d94696b6387faa09120883 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.655359 25640 raft_consensus.cc:482] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.655314 25631 consensus_queue.cc:260] T e0276f38a2d94696b6387faa09120883 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.655472 25640 raft_consensus.cc:504] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.655788 25631 ts_tablet_manager.cc:1398] T e0276f38a2d94696b6387faa09120883 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:27.656049 25631 tablet_bootstrap.cc:492] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.656188 25633 raft_consensus.cc:482] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.656283 25633 raft_consensus.cc:504] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.656809 25633 leader_election.cc:288] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.657502 25631 tablet_bootstrap.cc:654] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.656065 25640 leader_election.cc:288] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.660518 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0276f38a2d94696b6387faa09120883" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.660634 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c74d58e57f044068af88fcb359615ada" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.660691 25589 raft_consensus.cc:2454] T e0276f38a2d94696b6387faa09120883 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
W20240502 01:55:27.661024 25483 leader_election.cc:341] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.661118 25407 leader_election.cc:302] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.661255 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c74d58e57f044068af88fcb359615ada" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.661471 25640 raft_consensus.cc:2781] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.661558 25640 raft_consensus.cc:482] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.661615 25640 raft_consensus.cc:3037] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
W20240502 01:55:27.661648 25483 leader_election.cc:341] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.661743 25483 leader_election.cc:302] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9; no voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.662058 25658 raft_consensus.cc:2726] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:27.662359 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0276f38a2d94696b6387faa09120883" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.662513 25516 raft_consensus.cc:2454] T e0276f38a2d94696b6387faa09120883 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:27.664022 25640 raft_consensus.cc:504] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.665326 25640 leader_election.cc:288] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.665627 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0276f38a2d94696b6387faa09120883" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:27.665772 25591 raft_consensus.cc:3037] T e0276f38a2d94696b6387faa09120883 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.668347 25591 raft_consensus.cc:2454] T e0276f38a2d94696b6387faa09120883 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:27.668706 25407 leader_election.cc:302] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.669047 25640 raft_consensus.cc:2781] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.671056 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0276f38a2d94696b6387faa09120883" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.671262 25516 raft_consensus.cc:3037] T e0276f38a2d94696b6387faa09120883 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.673864 25516 raft_consensus.cc:2454] T e0276f38a2d94696b6387faa09120883 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:27.688882 25709 raft_consensus.cc:482] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.689054 25709 raft_consensus.cc:504] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.690304 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02a8e17203f54aa7b857bf0768799d3b" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.690572 25591 raft_consensus.cc:2379] T 02a8e17203f54aa7b857bf0768799d3b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 481341cc6302403dab5dcc402f42a81f in current term 1: Already voted for candidate 77c36b03bf7c42a9a430cc595953aff9 in this term.
I20240502 01:55:27.691169 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02a8e17203f54aa7b857bf0768799d3b" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.691709 25406 leader_election.cc:302] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.692015 25640 raft_consensus.cc:686] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:27.692340 25640 consensus_queue.cc:237] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.694873 25709 leader_election.cc:288] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.695240 25709 raft_consensus.cc:3037] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.695101 25337 catalog_manager.cc:5484] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:27.697996 25709 raft_consensus.cc:2726] T 02a8e17203f54aa7b857bf0768799d3b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:27.698153 25691 raft_consensus.cc:482] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.698319 25691 raft_consensus.cc:504] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.699275 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40e8e94fa76d49eebe0a9572ff2b3f12" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.699329 25691 leader_election.cc:288] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.700182 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40e8e94fa76d49eebe0a9572ff2b3f12" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.700443 25516 raft_consensus.cc:2379] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 481341cc6302403dab5dcc402f42a81f in this term.
I20240502 01:55:27.700855 25556 leader_election.cc:302] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:27.701323 25691 raft_consensus.cc:3037] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.703905 25691 raft_consensus.cc:2726] T 40e8e94fa76d49eebe0a9572ff2b3f12 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:27.705327 25658 raft_consensus.cc:482] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.705446 25658 raft_consensus.cc:504] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.705932 25658 leader_election.cc:288] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.706418 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc6480138d14df397ca2db53ca652d2" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.706578 25441 raft_consensus.cc:2454] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:27.706948 25483 leader_election.cc:302] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:27.707397 25658 raft_consensus.cc:2781] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.707476 25658 raft_consensus.cc:482] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.707547 25658 raft_consensus.cc:3037] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.708149 25635 tablet_bootstrap.cc:492] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.708274 25635 ts_tablet_manager.cc:1367] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.057s user 0.021s sys 0.006s
I20240502 01:55:27.708870 25635 raft_consensus.cc:348] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.709007 25635 raft_consensus.cc:374] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.709057 25635 raft_consensus.cc:729] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.709232 25635 consensus_queue.cc:260] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.709619 25635 ts_tablet_manager.cc:1398] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:27.709844 25635 tablet_bootstrap.cc:492] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.709867 25658 raft_consensus.cc:504] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.710351 25658 leader_election.cc:288] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.710904 25635 tablet_bootstrap.cc:654] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.711027 25691 raft_consensus.cc:482] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.711149 25691 raft_consensus.cc:504] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.711252 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc6480138d14df397ca2db53ca652d2" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:27.711386 25589 raft_consensus.cc:3037] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.710855 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc6480138d14df397ca2db53ca652d2" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.711669 25441 raft_consensus.cc:3037] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.711949 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3b9d8250b2e491f8db5bde1649178cf" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.712102 25442 raft_consensus.cc:2454] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.712435 25557 leader_election.cc:302] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.713006 25680 raft_consensus.cc:2781] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.713088 25680 raft_consensus.cc:482] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.713152 25680 raft_consensus.cc:3037] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.714080 25441 raft_consensus.cc:2454] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:27.714110 25589 raft_consensus.cc:2454] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:27.714435 25483 leader_election.cc:302] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.714901 25658 raft_consensus.cc:2781] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.715114 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bc6480138d14df397ca2db53ca652d2" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.715257 25591 raft_consensus.cc:2362] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1. Re-sending same reply.
I20240502 01:55:27.715492 25635 tablet_bootstrap.cc:492] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.715615 25635 ts_tablet_manager.cc:1367] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20240502 01:55:27.715571 25680 raft_consensus.cc:504] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.715941 25658 raft_consensus.cc:686] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:27.716086 25680 leader_election.cc:288] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.716121 25635 raft_consensus.cc:348] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.716177 25658 consensus_queue.cc:237] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.716274 25635 raft_consensus.cc:374] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.716394 25635 raft_consensus.cc:729] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.716590 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3b9d8250b2e491f8db5bde1649178cf" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.716586 25635 consensus_queue.cc:260] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.716753 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3b9d8250b2e491f8db5bde1649178cf" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.716959 25441 raft_consensus.cc:3037] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.717131 25635 ts_tablet_manager.cc:1398] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
W20240502 01:55:27.717180 25556 leader_election.cc:341] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.717396 25635 tablet_bootstrap.cc:492] T 119ec541c59f445980a1f04ba3890990 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.717770 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3b9d8250b2e491f8db5bde1649178cf" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
W20240502 01:55:27.718199 25556 leader_election.cc:341] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.718340 25691 leader_election.cc:288] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.718716 25635 tablet_bootstrap.cc:654] T 119ec541c59f445980a1f04ba3890990 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.719332 25631 tablet_bootstrap.cc:492] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.719456 25631 ts_tablet_manager.cc:1367] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.025s
I20240502 01:55:27.719870 25441 raft_consensus.cc:2454] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.720075 25631 raft_consensus.cc:348] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.720261 25631 raft_consensus.cc:374] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.720306 25631 raft_consensus.cc:729] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.720283 25557 leader_election.cc:302] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:27.720494 25631 consensus_queue.cc:260] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.720815 25691 raft_consensus.cc:2781] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.720937 25631 ts_tablet_manager.cc:1398] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:55:27.721153 25631 tablet_bootstrap.cc:492] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.721369 25691 raft_consensus.cc:686] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:27.721660 25691 consensus_queue.cc:237] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.722457 25631 tablet_bootstrap.cc:654] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.726528 25633 raft_consensus.cc:482] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.726647 25633 raft_consensus.cc:504] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.727218 25633 leader_election.cc:288] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.727175 25337 catalog_manager.cc:5484] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:27.727682 25337 catalog_manager.cc:5484] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:27.727941 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f53a683b23346ae963d62ef4c84bee8" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.728091 25441 raft_consensus.cc:2454] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:27.728400 25483 leader_election.cc:302] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:27.728621 25633 raft_consensus.cc:2781] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.728689 25633 raft_consensus.cc:482] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.728747 25633 raft_consensus.cc:3037] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.729157 25339 catalog_manager.cc:5484] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:27.731302 25633 raft_consensus.cc:504] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.731870 25633 leader_election.cc:288] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.732424 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f53a683b23346ae963d62ef4c84bee8" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.732570 25442 raft_consensus.cc:3037] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.735122 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f53a683b23346ae963d62ef4c84bee8" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:27.735543 25483 leader_election.cc:341] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.736014 25442 raft_consensus.cc:2454] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:27.736392 25483 leader_election.cc:302] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.736812 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f53a683b23346ae963d62ef4c84bee8" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:27.737231 25483 leader_election.cc:341] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.737536 25633 raft_consensus.cc:2781] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.744001 25640 raft_consensus.cc:482] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.744134 25640 raft_consensus.cc:504] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.744715 25640 leader_election.cc:288] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.745350 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a07dbbae54d745d49344fbaa9fe89f75" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.745476 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a07dbbae54d745d49344fbaa9fe89f75" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.745513 25516 raft_consensus.cc:2454] T a07dbbae54d745d49344fbaa9fe89f75 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:27.745836 25406 leader_election.cc:302] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:27.746014 25633 raft_consensus.cc:686] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:27.746172 25640 raft_consensus.cc:2781] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.746260 25640 raft_consensus.cc:482] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.746284 25709 raft_consensus.cc:482] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20240502 01:55:27.746194 25407 leader_election.cc:341] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.746419 25709 raft_consensus.cc:504] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.746336 25640 raft_consensus.cc:3037] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.746968 25709 leader_election.cc:288] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.746279 25633 consensus_queue.cc:237] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.748095 25631 tablet_bootstrap.cc:492] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.748258 25631 ts_tablet_manager.cc:1367] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.014s
I20240502 01:55:27.748790 25637 tablet_bootstrap.cc:492] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.748855 25640 raft_consensus.cc:504] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.748951 25631 raft_consensus.cc:348] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.749228 25631 raft_consensus.cc:374] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.749325 25631 raft_consensus.cc:729] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.749557 25631 consensus_queue.cc:260] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.749820 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea9ec0f8b8514c50b369b7e89182da95" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.749905 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a07dbbae54d745d49344fbaa9fe89f75" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.750079 25631 ts_tablet_manager.cc:1398] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:27.750110 25517 raft_consensus.cc:3037] T a07dbbae54d745d49344fbaa9fe89f75 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
W20240502 01:55:27.750280 25406 leader_election.cc:341] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.750365 25631 tablet_bootstrap.cc:492] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.750396 25339 catalog_manager.cc:5484] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:27.751376 25631 tablet_bootstrap.cc:654] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.748953 25637 ts_tablet_manager.cc:1367] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.106s user 0.035s sys 0.031s
I20240502 01:55:27.752414 25637 raft_consensus.cc:348] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.752553 25637 raft_consensus.cc:374] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.752624 25637 raft_consensus.cc:729] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.752637 25517 raft_consensus.cc:2454] T a07dbbae54d745d49344fbaa9fe89f75 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:27.752772 25637 consensus_queue.cc:260] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.753072 25406 leader_election.cc:302] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:27.753264 25637 ts_tablet_manager.cc:1398] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:27.753234 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea9ec0f8b8514c50b369b7e89182da95" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.753358 25709 raft_consensus.cc:2781] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.753487 25709 raft_consensus.cc:686] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
W20240502 01:55:27.753679 25407 leader_election.cc:341] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.753829 25407 leader_election.cc:302] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.754216 25710 raft_consensus.cc:2726] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:27.753753 25709 consensus_queue.cc:237] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.755348 25640 leader_election.cc:288] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.758556 25637 tablet_bootstrap.cc:492] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.758373 25337 catalog_manager.cc:5484] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:27.760192 25637 tablet_bootstrap.cc:654] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.760847 25635 tablet_bootstrap.cc:492] T 119ec541c59f445980a1f04ba3890990 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.761016 25635 ts_tablet_manager.cc:1367] T 119ec541c59f445980a1f04ba3890990 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.044s user 0.010s sys 0.017s
I20240502 01:55:27.761684 25635 raft_consensus.cc:348] T 119ec541c59f445980a1f04ba3890990 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.761898 25635 raft_consensus.cc:374] T 119ec541c59f445980a1f04ba3890990 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.762001 25635 raft_consensus.cc:729] T 119ec541c59f445980a1f04ba3890990 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.762167 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a07dbbae54d745d49344fbaa9fe89f75" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:27.762616 25407 leader_election.cc:341] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.764030 25635 consensus_queue.cc:260] T 119ec541c59f445980a1f04ba3890990 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.764585 25635 ts_tablet_manager.cc:1398] T 119ec541c59f445980a1f04ba3890990 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:55:27.764886 25635 tablet_bootstrap.cc:492] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.766283 25635 tablet_bootstrap.cc:654] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.768837 25337 catalog_manager.cc:5484] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:27.770398 25691 raft_consensus.cc:482] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.770567 25691 raft_consensus.cc:504] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.771200 25691 leader_election.cc:288] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.771771 25658 raft_consensus.cc:482] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.771920 25658 raft_consensus.cc:504] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.772482 25658 leader_election.cc:288] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.772519 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34fff5148ef24f36b798374c1bfc6f69" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.772687 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34fff5148ef24f36b798374c1bfc6f69" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.772910 25441 raft_consensus.cc:2454] T 34fff5148ef24f36b798374c1bfc6f69 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.773391 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b44011e7fc24cb085f97afa28a0295f" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.773458 25557 leader_election.cc:302] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.772717 25517 raft_consensus.cc:2454] T 34fff5148ef24f36b798374c1bfc6f69 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.773844 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b44011e7fc24cb085f97afa28a0295f" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
W20240502 01:55:27.773927 25483 leader_election.cc:341] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.774169 25691 raft_consensus.cc:2781] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.774291 25691 raft_consensus.cc:482] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20240502 01:55:27.774389 25483 leader_election.cc:341] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.774566 25483 leader_election.cc:302] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9; no voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.775079 25658 raft_consensus.cc:2726] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:27.774403 25691 raft_consensus.cc:3037] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.777925 25691 raft_consensus.cc:504] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.778914 25691 leader_election.cc:288] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.778961 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34fff5148ef24f36b798374c1bfc6f69" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.779013 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34fff5148ef24f36b798374c1bfc6f69" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.779165 25441 raft_consensus.cc:3037] T 34fff5148ef24f36b798374c1bfc6f69 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.779202 25517 raft_consensus.cc:3037] T 34fff5148ef24f36b798374c1bfc6f69 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.779595 25635 tablet_bootstrap.cc:492] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.779772 25635 ts_tablet_manager.cc:1367] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.004s
I20240502 01:55:27.780364 25635 raft_consensus.cc:348] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.780570 25635 raft_consensus.cc:374] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.778921 25631 tablet_bootstrap.cc:492] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.780681 25635 raft_consensus.cc:729] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.780915 25631 ts_tablet_manager.cc:1367] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.031s user 0.010s sys 0.014s
I20240502 01:55:27.780968 25635 consensus_queue.cc:260] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.781121 25441 raft_consensus.cc:2454] T 34fff5148ef24f36b798374c1bfc6f69 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.781703 25517 raft_consensus.cc:2454] T 34fff5148ef24f36b798374c1bfc6f69 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.782485 25637 tablet_bootstrap.cc:492] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.782449 25631 raft_consensus.cc:348] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.782480 25557 leader_election.cc:302] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.782495 25635 ts_tablet_manager.cc:1398] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:27.782783 25637 ts_tablet_manager.cc:1367] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.008s
I20240502 01:55:27.782946 25691 raft_consensus.cc:2781] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.783262 25691 raft_consensus.cc:686] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:27.783274 25635 tablet_bootstrap.cc:492] T c74d58e57f044068af88fcb359615ada P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.783546 25691 consensus_queue.cc:237] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.783902 25637 raft_consensus.cc:348] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.784112 25637 raft_consensus.cc:374] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.784209 25637 raft_consensus.cc:729] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.784467 25637 consensus_queue.cc:260] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.784978 25637 ts_tablet_manager.cc:1398] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:55:27.785266 25637 tablet_bootstrap.cc:492] T 1b44011e7fc24cb085f97afa28a0295f P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.785274 25635 tablet_bootstrap.cc:654] T c74d58e57f044068af88fcb359615ada P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.782668 25631 raft_consensus.cc:374] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.785748 25631 raft_consensus.cc:729] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.785990 25631 consensus_queue.cc:260] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.786495 25631 ts_tablet_manager.cc:1398] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20240502 01:55:27.786563 25637 tablet_bootstrap.cc:654] T 1b44011e7fc24cb085f97afa28a0295f P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.787282 25631 tablet_bootstrap.cc:492] T 47b72129270d4be3bf173be990d530f3 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.788697 25631 tablet_bootstrap.cc:654] T 47b72129270d4be3bf173be990d530f3 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.793574 25337 catalog_manager.cc:5484] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:27.794195 25637 tablet_bootstrap.cc:492] T 1b44011e7fc24cb085f97afa28a0295f P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.794344 25637 ts_tablet_manager.cc:1367] T 1b44011e7fc24cb085f97afa28a0295f P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.005s
I20240502 01:55:27.795022 25637 raft_consensus.cc:348] T 1b44011e7fc24cb085f97afa28a0295f P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.795223 25637 raft_consensus.cc:374] T 1b44011e7fc24cb085f97afa28a0295f P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.795334 25637 raft_consensus.cc:729] T 1b44011e7fc24cb085f97afa28a0295f P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.795558 25637 consensus_queue.cc:260] T 1b44011e7fc24cb085f97afa28a0295f P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.796123 25637 ts_tablet_manager.cc:1398] T 1b44011e7fc24cb085f97afa28a0295f P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:27.796401 25637 tablet_bootstrap.cc:492] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.797605 25637 tablet_bootstrap.cc:654] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.799646 25635 tablet_bootstrap.cc:492] T c74d58e57f044068af88fcb359615ada P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.799813 25635 ts_tablet_manager.cc:1367] T c74d58e57f044068af88fcb359615ada P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.005s
I20240502 01:55:27.799995 25637 tablet_bootstrap.cc:492] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.800158 25637 ts_tablet_manager.cc:1367] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240502 01:55:27.800503 25635 raft_consensus.cc:348] T c74d58e57f044068af88fcb359615ada P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.800714 25635 raft_consensus.cc:374] T c74d58e57f044068af88fcb359615ada P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.800668 25637 raft_consensus.cc:348] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.800815 25635 raft_consensus.cc:729] T c74d58e57f044068af88fcb359615ada P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.800885 25637 raft_consensus.cc:374] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.800969 25637 raft_consensus.cc:729] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.801069 25635 consensus_queue.cc:260] T c74d58e57f044068af88fcb359615ada P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.801192 25637 consensus_queue.cc:260] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.801653 25637 ts_tablet_manager.cc:1398] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:27.802019 25637 tablet_bootstrap.cc:492] T ea9ec0f8b8514c50b369b7e89182da95 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.803269 25637 tablet_bootstrap.cc:654] T ea9ec0f8b8514c50b369b7e89182da95 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.803907 25635 ts_tablet_manager.cc:1398] T c74d58e57f044068af88fcb359615ada P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 01:55:27.804188 25635 tablet_bootstrap.cc:492] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.805440 25635 tablet_bootstrap.cc:654] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.807139 25631 tablet_bootstrap.cc:492] T 47b72129270d4be3bf173be990d530f3 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.807304 25631 ts_tablet_manager.cc:1367] T 47b72129270d4be3bf173be990d530f3 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.009s
I20240502 01:55:27.807638 25635 tablet_bootstrap.cc:492] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.807799 25635 ts_tablet_manager.cc:1367] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240502 01:55:27.807925 25631 raft_consensus.cc:348] T 47b72129270d4be3bf173be990d530f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.808136 25631 raft_consensus.cc:374] T 47b72129270d4be3bf173be990d530f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.808225 25631 raft_consensus.cc:729] T 47b72129270d4be3bf173be990d530f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.808470 25631 consensus_queue.cc:260] T 47b72129270d4be3bf173be990d530f3 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.808475 25635 raft_consensus.cc:348] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.808996 25631 ts_tablet_manager.cc:1398] T 47b72129270d4be3bf173be990d530f3 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 01:55:27.809316 25631 tablet_bootstrap.cc:492] T 8399bb471a684ee8880fdd9ad668fff3 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.809382 25635 raft_consensus.cc:374] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.809471 25635 raft_consensus.cc:729] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.809883 25635 consensus_queue.cc:260] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.810595 25631 tablet_bootstrap.cc:654] T 8399bb471a684ee8880fdd9ad668fff3 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.810868 25637 tablet_bootstrap.cc:492] T ea9ec0f8b8514c50b369b7e89182da95 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.811015 25637 ts_tablet_manager.cc:1367] T ea9ec0f8b8514c50b369b7e89182da95 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.005s
I20240502 01:55:27.811553 25637 raft_consensus.cc:348] T ea9ec0f8b8514c50b369b7e89182da95 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.811702 25637 raft_consensus.cc:374] T ea9ec0f8b8514c50b369b7e89182da95 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.811805 25637 raft_consensus.cc:729] T ea9ec0f8b8514c50b369b7e89182da95 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.812014 25637 consensus_queue.cc:260] T ea9ec0f8b8514c50b369b7e89182da95 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.812491 25637 ts_tablet_manager.cc:1398] T ea9ec0f8b8514c50b369b7e89182da95 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:27.812764 25637 tablet_bootstrap.cc:492] T ef2c1bf82b7f4e5f8e079a9502e236b0 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.813673 25635 ts_tablet_manager.cc:1398] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240502 01:55:27.814224 25637 tablet_bootstrap.cc:654] T ef2c1bf82b7f4e5f8e079a9502e236b0 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.815026 25635 tablet_bootstrap.cc:492] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.816529 25635 tablet_bootstrap.cc:654] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.819208 25637 tablet_bootstrap.cc:492] T ef2c1bf82b7f4e5f8e079a9502e236b0 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.819360 25637 ts_tablet_manager.cc:1367] T ef2c1bf82b7f4e5f8e079a9502e236b0 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20240502 01:55:27.819484 25631 tablet_bootstrap.cc:492] T 8399bb471a684ee8880fdd9ad668fff3 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.819622 25631 ts_tablet_manager.cc:1367] T 8399bb471a684ee8880fdd9ad668fff3 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20240502 01:55:27.819919 25637 raft_consensus.cc:348] T ef2c1bf82b7f4e5f8e079a9502e236b0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.820076 25637 raft_consensus.cc:374] T ef2c1bf82b7f4e5f8e079a9502e236b0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.820161 25637 raft_consensus.cc:729] T ef2c1bf82b7f4e5f8e079a9502e236b0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.820181 25631 raft_consensus.cc:348] T 8399bb471a684ee8880fdd9ad668fff3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.820384 25631 raft_consensus.cc:374] T 8399bb471a684ee8880fdd9ad668fff3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.820441 25691 raft_consensus.cc:482] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.820509 25631 raft_consensus.cc:729] T 8399bb471a684ee8880fdd9ad668fff3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.820387 25637 consensus_queue.cc:260] T ef2c1bf82b7f4e5f8e079a9502e236b0 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.820612 25691 raft_consensus.cc:504] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.820782 25631 consensus_queue.cc:260] T 8399bb471a684ee8880fdd9ad668fff3 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.821213 25637 ts_tablet_manager.cc:1398] T ef2c1bf82b7f4e5f8e079a9502e236b0 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:55:27.821265 25691 leader_election.cc:288] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.821607 25637 tablet_bootstrap.cc:492] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.821853 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "082a20c28ee243268963c85be001faa7" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.822075 25517 raft_consensus.cc:2454] T 082a20c28ee243268963c85be001faa7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.822153 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "082a20c28ee243268963c85be001faa7" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.822373 25441 raft_consensus.cc:2454] T 082a20c28ee243268963c85be001faa7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.822511 25556 leader_election.cc:302] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.822813 25658 raft_consensus.cc:482] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.822866 25691 raft_consensus.cc:2781] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.823009 25691 raft_consensus.cc:482] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.823151 25691 raft_consensus.cc:3037] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.823014 25658 raft_consensus.cc:504] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.823748 25637 tablet_bootstrap.cc:654] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.823978 25658 leader_election.cc:288] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.824602 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3b9d8250b2e491f8db5bde1649178cf" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.824857 25441 raft_consensus.cc:2379] T f3b9d8250b2e491f8db5bde1649178cf P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c36b03bf7c42a9a430cc595953aff9 in current term 1: Already voted for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in this term.
I20240502 01:55:27.825318 25635 tablet_bootstrap.cc:492] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.825464 25635 ts_tablet_manager.cc:1367] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20240502 01:55:27.825625 25691 raft_consensus.cc:504] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.826160 25635 raft_consensus.cc:348] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.826359 25635 raft_consensus.cc:374] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.826467 25635 raft_consensus.cc:729] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.826685 25635 consensus_queue.cc:260] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.827008 25631 ts_tablet_manager.cc:1398] T 8399bb471a684ee8880fdd9ad668fff3 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20240502 01:55:27.827106 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3b9d8250b2e491f8db5bde1649178cf" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.827271 25635 ts_tablet_manager.cc:1398] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:27.827560 25635 tablet_bootstrap.cc:492] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.828966 25635 tablet_bootstrap.cc:654] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.829088 25483 leader_election.cc:302] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9; no voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.829481 25658 raft_consensus.cc:3037] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.830405 25631 tablet_bootstrap.cc:492] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.831962 25631 tablet_bootstrap.cc:654] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.832043 25658 raft_consensus.cc:2726] T f3b9d8250b2e491f8db5bde1649178cf P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:27.832361 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "082a20c28ee243268963c85be001faa7" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.832571 25441 raft_consensus.cc:3037] T 082a20c28ee243268963c85be001faa7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.834048 25635 tablet_bootstrap.cc:492] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.834211 25635 ts_tablet_manager.cc:1367] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20240502 01:55:27.834841 25635 raft_consensus.cc:348] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.835054 25635 raft_consensus.cc:374] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.835150 25635 raft_consensus.cc:729] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.835410 25635 consensus_queue.cc:260] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.835680 25441 raft_consensus.cc:2454] T 082a20c28ee243268963c85be001faa7 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.836017 25557 leader_election.cc:302] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.836314 25680 raft_consensus.cc:2781] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.836465 25680 raft_consensus.cc:686] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:27.836850 25635 ts_tablet_manager.cc:1398] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:55:27.836740 25680 consensus_queue.cc:237] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.837136 25635 tablet_bootstrap.cc:492] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.838595 25635 tablet_bootstrap.cc:654] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.839583 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "082a20c28ee243268963c85be001faa7" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.839787 25517 raft_consensus.cc:3037] T 082a20c28ee243268963c85be001faa7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.842301 25517 raft_consensus.cc:2454] T 082a20c28ee243268963c85be001faa7 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.839804 25709 raft_consensus.cc:482] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.842641 25709 raft_consensus.cc:504] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.843252 25709 leader_election.cc:288] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.843711 25631 tablet_bootstrap.cc:492] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.843946 25631 ts_tablet_manager.cc:1367] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.003s
I20240502 01:55:27.844072 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef2c1bf82b7f4e5f8e079a9502e236b0" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.844322 25591 raft_consensus.cc:2454] T ef2c1bf82b7f4e5f8e079a9502e236b0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:27.844755 25407 leader_election.cc:302] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.844856 25631 raft_consensus.cc:348] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.845094 25709 raft_consensus.cc:2781] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.845250 25709 raft_consensus.cc:482] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.845381 25709 raft_consensus.cc:3037] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.845428 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef2c1bf82b7f4e5f8e079a9502e236b0" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.845665 25517 raft_consensus.cc:2454] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:27.846372 25635 tablet_bootstrap.cc:492] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.846377 25691 leader_election.cc:288] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.846518 25635 ts_tablet_manager.cc:1367] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.004s
I20240502 01:55:27.847244 25635 raft_consensus.cc:348] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.847452 25635 raft_consensus.cc:374] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.847550 25635 raft_consensus.cc:729] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.847808 25635 consensus_queue.cc:260] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.848397 25709 raft_consensus.cc:504] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.849161 25709 leader_election.cc:288] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.849406 25631 raft_consensus.cc:374] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.849545 25631 raft_consensus.cc:729] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.849612 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef2c1bf82b7f4e5f8e079a9502e236b0" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:27.849805 25591 raft_consensus.cc:3037] T ef2c1bf82b7f4e5f8e079a9502e236b0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.849951 25631 consensus_queue.cc:260] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.850546 25631 ts_tablet_manager.cc:1398] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240502 01:55:27.850647 25635 ts_tablet_manager.cc:1398] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:55:27.851665 25631 tablet_bootstrap.cc:492] T 62d013793fcb4f2a9fe28d149040f721 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.852298 25591 raft_consensus.cc:2454] T ef2c1bf82b7f4e5f8e079a9502e236b0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:27.853042 25407 leader_election.cc:302] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.853102 25635 tablet_bootstrap.cc:492] T 45cdd96cf1414bf794042b2d514aa82a P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.853312 25709 raft_consensus.cc:2781] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.853482 25709 raft_consensus.cc:686] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:27.853772 25691 raft_consensus.cc:482] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.853724 25709 consensus_queue.cc:237] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.853917 25691 raft_consensus.cc:504] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.854815 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c74d58e57f044068af88fcb359615ada" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.855044 25516 raft_consensus.cc:2454] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.855444 25556 leader_election.cc:302] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.855687 25691 leader_election.cc:288] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.855687 25644 raft_consensus.cc:2781] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.856017 25644 raft_consensus.cc:482] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.856137 25644 raft_consensus.cc:3037] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.856834 25635 tablet_bootstrap.cc:654] T 45cdd96cf1414bf794042b2d514aa82a P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.858212 25631 tablet_bootstrap.cc:654] T 62d013793fcb4f2a9fe28d149040f721 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.860456 25640 raft_consensus.cc:482] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.860613 25640 raft_consensus.cc:504] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.861230 25640 leader_election.cc:288] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.861850 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.862076 25516 raft_consensus.cc:2454] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:27.862489 25406 leader_election.cc:302] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:27.862985 25640 raft_consensus.cc:2781] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.863116 25640 raft_consensus.cc:482] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.863214 25640 raft_consensus.cc:3037] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.865849 25640 raft_consensus.cc:504] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.867206 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.867446 25516 raft_consensus.cc:3037] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.870090 25516 raft_consensus.cc:2454] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:27.870602 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:27.870919 25640 leader_election.cc:288] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.870965 25691 raft_consensus.cc:482] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.871080 25691 raft_consensus.cc:504] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.871177 25406 leader_election.cc:302] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
W20240502 01:55:27.871583 25407 leader_election.cc:341] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.871652 25691 leader_election.cc:288] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.858764 25644 raft_consensus.cc:504] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.872237 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f6789c3e6d44cff8e50f6a9af1a42e7" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.872427 25516 raft_consensus.cc:2454] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.872828 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c74d58e57f044068af88fcb359615ada" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.873080 25515 raft_consensus.cc:3037] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.874990 25556 leader_election.cc:302] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.875283 25691 raft_consensus.cc:2781] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.875398 25691 raft_consensus.cc:482] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.875492 25691 raft_consensus.cc:3037] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.878120 25691 raft_consensus.cc:504] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.878690 25691 leader_election.cc:288] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.879241 25644 leader_election.cc:288] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.879326 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f6789c3e6d44cff8e50f6a9af1a42e7" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.879498 25516 raft_consensus.cc:3037] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.880086 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f6789c3e6d44cff8e50f6a9af1a42e7" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.880046 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c74d58e57f044068af88fcb359615ada" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.880298 25440 raft_consensus.cc:3037] T c74d58e57f044068af88fcb359615ada P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.881342 25515 raft_consensus.cc:2454] T c74d58e57f044068af88fcb359615ada P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.881716 25556 leader_election.cc:302] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.881956 25658 raft_consensus.cc:482] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.882088 25516 raft_consensus.cc:2454] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.882109 25658 raft_consensus.cc:504] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.882398 25439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f6789c3e6d44cff8e50f6a9af1a42e7" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.882615 25658 leader_election.cc:288] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.882797 25644 raft_consensus.cc:2781] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.882961 25644 raft_consensus.cc:686] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:27.883265 25439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.883525 25439 raft_consensus.cc:2454] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:27.883575 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.880302 25442 raft_consensus.cc:2454] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.883291 25440 raft_consensus.cc:2454] T c74d58e57f044068af88fcb359615ada P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:27.883939 25556 leader_election.cc:302] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:27.884222 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:27.884265 25483 leader_election.cc:302] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
W20240502 01:55:27.884565 25483 leader_election.cc:341] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.884626 25691 raft_consensus.cc:2781] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.884749 25691 raft_consensus.cc:686] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:27.885015 25691 consensus_queue.cc:237] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
W20240502 01:55:27.885675 25407 leader_election.cc:341] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.886047 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef2c1bf82b7f4e5f8e079a9502e236b0" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.886235 25517 raft_consensus.cc:3037] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.888993 25517 raft_consensus.cc:2454] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:27.889595 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c74d58e57f044068af88fcb359615ada" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.889782 25441 raft_consensus.cc:2362] T c74d58e57f044068af88fcb359615ada P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1. Re-sending same reply.
I20240502 01:55:27.890411 25658 raft_consensus.cc:2781] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20240502 01:55:27.890515 25658 raft_consensus.cc:482] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.890623 25658 raft_consensus.cc:3037] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:55:27.883258 25644 consensus_queue.cc:237] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.893728 25640 raft_consensus.cc:2781] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.893980 25640 raft_consensus.cc:686] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:27.894256 25640 consensus_queue.cc:237] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.900574 25658 raft_consensus.cc:504] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.901423 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.905455 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:27.905921 25483 leader_election.cc:341] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.906057 25483 leader_election.cc:302] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9; no voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.906324 25633 raft_consensus.cc:2726] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20240502 01:55:27.906920 25658 leader_election.cc:288] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 2 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.913440 25710 raft_consensus.cc:482] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.913614 25710 raft_consensus.cc:504] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.914208 25710 leader_election.cc:288] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:27.914949 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fafad230c13400391bdbba1ac1ee318" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:27.915449 25407 leader_election.cc:341] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.915707 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fafad230c13400391bdbba1ac1ee318" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
W20240502 01:55:27.916131 25406 leader_election.cc:341] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.916256 25406 leader_election.cc:302] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:27.916657 25710 raft_consensus.cc:2726] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:27.925338 25339 catalog_manager.cc:5484] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:27.925859 25338 catalog_manager.cc:5484] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:27.932302 25339 catalog_manager.cc:5484] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:27.937410 25631 tablet_bootstrap.cc:492] T 62d013793fcb4f2a9fe28d149040f721 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.937623 25631 ts_tablet_manager.cc:1367] T 62d013793fcb4f2a9fe28d149040f721 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.086s user 0.018s sys 0.022s
I20240502 01:55:27.937804 25637 tablet_bootstrap.cc:492] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.937959 25637 ts_tablet_manager.cc:1367] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.116s user 0.028s sys 0.085s
I20240502 01:55:27.938658 25631 raft_consensus.cc:348] T 62d013793fcb4f2a9fe28d149040f721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.938629 25637 raft_consensus.cc:348] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.938908 25631 raft_consensus.cc:374] T 62d013793fcb4f2a9fe28d149040f721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.938957 25637 raft_consensus.cc:374] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.939124 25635 tablet_bootstrap.cc:492] T 45cdd96cf1414bf794042b2d514aa82a P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.939234 25637 raft_consensus.cc:729] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.939306 25635 ts_tablet_manager.cc:1367] T 45cdd96cf1414bf794042b2d514aa82a P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.086s user 0.018s sys 0.029s
I20240502 01:55:27.939231 25631 raft_consensus.cc:729] T 62d013793fcb4f2a9fe28d149040f721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.939332 25339 catalog_manager.cc:5484] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:27.939555 25637 consensus_queue.cc:260] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.939700 25631 consensus_queue.cc:260] T 62d013793fcb4f2a9fe28d149040f721 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.939885 25339 catalog_manager.cc:5484] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:27.940150 25637 ts_tablet_manager.cc:1398] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:27.940122 25635 raft_consensus.cc:348] T 45cdd96cf1414bf794042b2d514aa82a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.940315 25635 raft_consensus.cc:374] T 45cdd96cf1414bf794042b2d514aa82a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.940397 25635 raft_consensus.cc:729] T 45cdd96cf1414bf794042b2d514aa82a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.940454 25637 tablet_bootstrap.cc:492] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.940665 25635 consensus_queue.cc:260] T 45cdd96cf1414bf794042b2d514aa82a P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.941159 25635 ts_tablet_manager.cc:1398] T 45cdd96cf1414bf794042b2d514aa82a P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:27.941465 25635 tablet_bootstrap.cc:492] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.942133 25637 tablet_bootstrap.cc:654] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.943122 25635 tablet_bootstrap.cc:654] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.945191 25631 ts_tablet_manager.cc:1398] T 62d013793fcb4f2a9fe28d149040f721 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20240502 01:55:27.945607 25631 tablet_bootstrap.cc:492] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.947485 25631 tablet_bootstrap.cc:654] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.948753 25635 tablet_bootstrap.cc:492] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.948865 25635 ts_tablet_manager.cc:1367] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20240502 01:55:27.949396 25635 raft_consensus.cc:348] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.949537 25635 raft_consensus.cc:374] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.949599 25635 raft_consensus.cc:729] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.949772 25635 consensus_queue.cc:260] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.950054 25637 tablet_bootstrap.cc:492] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.950168 25637 ts_tablet_manager.cc:1367] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.001s
I20240502 01:55:27.950285 25635 ts_tablet_manager.cc:1398] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:55:27.950546 25635 tablet_bootstrap.cc:492] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.950660 25637 raft_consensus.cc:348] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.950805 25637 raft_consensus.cc:374] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.950883 25637 raft_consensus.cc:729] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.951076 25637 consensus_queue.cc:260] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.951577 25637 ts_tablet_manager.cc:1398] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:55:27.951812 25637 tablet_bootstrap.cc:492] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.951817 25635 tablet_bootstrap.cc:654] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.952956 25637 tablet_bootstrap.cc:654] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.953495 25441 raft_consensus.cc:3037] T 005b796aabf04ae79928bc4457a209db P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.956678 25658 consensus_queue.cc:1035] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:27.956838 25691 consensus_queue.cc:1035] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:27.966107 25644 consensus_queue.cc:1035] T 005b796aabf04ae79928bc4457a209db P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:27.967483 25644 raft_consensus.cc:482] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.967604 25644 raft_consensus.cc:504] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.967924 25635 tablet_bootstrap.cc:492] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.968046 25635 ts_tablet_manager.cc:1367] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.000s
I20240502 01:55:27.968161 25644 leader_election.cc:288] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.968405 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f64edf93e440f9b455caa1fcc9f3a4" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.968565 25441 raft_consensus.cc:2454] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:27.968686 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f64edf93e440f9b455caa1fcc9f3a4" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.968942 25557 leader_election.cc:302] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
W20240502 01:55:27.969116 25556 leader_election.cc:341] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.969200 25644 raft_consensus.cc:2781] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:27.969262 25644 raft_consensus.cc:482] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:27.969314 25644 raft_consensus.cc:3037] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.969870 25635 raft_consensus.cc:348] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.969997 25635 raft_consensus.cc:374] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.970049 25635 raft_consensus.cc:729] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.970232 25635 consensus_queue.cc:260] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.970650 25635 ts_tablet_manager.cc:1398] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:55:27.970890 25635 tablet_bootstrap.cc:492] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.971773 25635 tablet_bootstrap.cc:654] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.971890 25644 raft_consensus.cc:504] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.972735 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f64edf93e440f9b455caa1fcc9f3a4" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:27.972899 25441 raft_consensus.cc:3037] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:27.974316 25644 leader_election.cc:288] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.974519 25637 tablet_bootstrap.cc:492] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:27.974618 25637 ts_tablet_manager.cc:1367] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.011s
I20240502 01:55:27.974663 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f64edf93e440f9b455caa1fcc9f3a4" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:27.974993 25441 raft_consensus.cc:2454] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
W20240502 01:55:27.975129 25556 leader_election.cc:341] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:27.975209 25637 raft_consensus.cc:348] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.975378 25637 raft_consensus.cc:374] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.975435 25637 raft_consensus.cc:729] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.975607 25637 consensus_queue.cc:260] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.976269 25557 leader_election.cc:302] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:27.976984 25635 tablet_bootstrap.cc:492] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:27.977084 25635 ts_tablet_manager.cc:1367] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 01:55:27.977632 25635 raft_consensus.cc:348] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.977746 25691 raft_consensus.cc:2781] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:27.977792 25635 raft_consensus.cc:374] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.977844 25635 raft_consensus.cc:729] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.977860 25691 raft_consensus.cc:686] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:27.978005 25635 consensus_queue.cc:260] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.978101 25691 consensus_queue.cc:237] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.978493 25635 ts_tablet_manager.cc:1398] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:55:27.978741 25635 tablet_bootstrap.cc:492] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:27.979094 25687 raft_consensus.cc:482] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:27.979213 25687 raft_consensus.cc:504] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.979737 25687 leader_election.cc:288] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:27.979878 25635 tablet_bootstrap.cc:654] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.980161 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:27.980473 25631 tablet_bootstrap.cc:492] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.980587 25631 ts_tablet_manager.cc:1367] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.035s user 0.016s sys 0.003s
I20240502 01:55:27.981040 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:27.981258 25516 raft_consensus.cc:2354] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 for earlier term 1. Current term is 2.
I20240502 01:55:27.981160 25631 raft_consensus.cc:348] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.981353 25631 raft_consensus.cc:374] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.981405 25631 raft_consensus.cc:729] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.981606 25631 consensus_queue.cc:260] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.981787 25556 leader_election.cc:398] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Vote denied by peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163) with higher term. Message: Invalid argument: T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 for earlier term 1. Current term is 2.
I20240502 01:55:27.981849 25556 leader_election.cc:401] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20240502 01:55:27.982137 25631 ts_tablet_manager.cc:1398] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 01:55:27.982277 25687 consensus_queue.cc:1035] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:27.982372 25631 tablet_bootstrap.cc:492] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.982645 25687 raft_consensus.cc:3037] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 2
I20240502 01:55:27.983685 25631 tablet_bootstrap.cc:654] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.985191 25687 raft_consensus.cc:2726] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163) with higher term. Message: Invalid argument: T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 for earlier term 1. Current term is 2.
I20240502 01:55:27.988642 25687 consensus_queue.cc:1035] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:27.990274 25637 ts_tablet_manager.cc:1398] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20240502 01:55:27.990542 25637 tablet_bootstrap.cc:492] T 62d013793fcb4f2a9fe28d149040f721 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:27.991781 25637 tablet_bootstrap.cc:654] T 62d013793fcb4f2a9fe28d149040f721 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:27.992911 25633 consensus_queue.cc:1035] T 02a8e17203f54aa7b857bf0768799d3b P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:27.994227 25631 tablet_bootstrap.cc:492] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:27.994341 25631 ts_tablet_manager.cc:1367] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20240502 01:55:27.994915 25631 raft_consensus.cc:348] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.995090 25631 raft_consensus.cc:374] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:27.995138 25631 raft_consensus.cc:729] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:27.995302 25631 consensus_queue.cc:260] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:27.995725 25631 ts_tablet_manager.cc:1398] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:55:27.995976 25631 tablet_bootstrap.cc:492] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:27.997263 25631 tablet_bootstrap.cc:654] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.000566 25635 tablet_bootstrap.cc:492] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.000685 25635 ts_tablet_manager.cc:1367] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.000s
I20240502 01:55:28.001230 25635 raft_consensus.cc:348] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.001399 25635 raft_consensus.cc:374] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.001447 25635 raft_consensus.cc:729] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.001612 25635 consensus_queue.cc:260] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.002156 25635 ts_tablet_manager.cc:1398] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:55:28.002395 25635 tablet_bootstrap.cc:492] T 8399bb471a684ee8880fdd9ad668fff3 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.003069 25637 tablet_bootstrap.cc:492] T 62d013793fcb4f2a9fe28d149040f721 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.003182 25637 ts_tablet_manager.cc:1367] T 62d013793fcb4f2a9fe28d149040f721 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240502 01:55:28.003567 25635 tablet_bootstrap.cc:654] T 8399bb471a684ee8880fdd9ad668fff3 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.003769 25637 raft_consensus.cc:348] T 62d013793fcb4f2a9fe28d149040f721 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.003945 25637 raft_consensus.cc:374] T 62d013793fcb4f2a9fe28d149040f721 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.003991 25637 raft_consensus.cc:729] T 62d013793fcb4f2a9fe28d149040f721 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.004159 25637 consensus_queue.cc:260] T 62d013793fcb4f2a9fe28d149040f721 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.004597 25637 ts_tablet_manager.cc:1398] T 62d013793fcb4f2a9fe28d149040f721 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:28.004843 25637 tablet_bootstrap.cc:492] T 45cdd96cf1414bf794042b2d514aa82a P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.006203 25637 tablet_bootstrap.cc:654] T 45cdd96cf1414bf794042b2d514aa82a P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.010259 25631 tablet_bootstrap.cc:492] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.010387 25631 ts_tablet_manager.cc:1367] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.008s
I20240502 01:55:28.010968 25631 raft_consensus.cc:348] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.011145 25631 raft_consensus.cc:374] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.011201 25631 raft_consensus.cc:729] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.011404 25631 consensus_queue.cc:260] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.014173 25631 ts_tablet_manager.cc:1398] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:55:28.014426 25631 tablet_bootstrap.cc:492] T 119ec541c59f445980a1f04ba3890990 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.015684 25338 catalog_manager.cc:5484] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:28.016924 25631 tablet_bootstrap.cc:654] T 119ec541c59f445980a1f04ba3890990 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.020206 25633 raft_consensus.cc:482] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.020329 25633 raft_consensus.cc:504] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.020861 25633 leader_election.cc:288] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.021417 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea9ec0f8b8514c50b369b7e89182da95" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.021605 25440 raft_consensus.cc:2454] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:28.021431 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea9ec0f8b8514c50b369b7e89182da95" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.021827 25591 raft_consensus.cc:2454] T ea9ec0f8b8514c50b369b7e89182da95 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:28.022290 25483 leader_election.cc:302] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.022549 25633 raft_consensus.cc:2781] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.022630 25633 raft_consensus.cc:482] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.022697 25633 raft_consensus.cc:3037] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.035537 25631 tablet_bootstrap.cc:492] T 119ec541c59f445980a1f04ba3890990 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.035549 25635 tablet_bootstrap.cc:492] T 8399bb471a684ee8880fdd9ad668fff3 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.035693 25635 ts_tablet_manager.cc:1367] T 8399bb471a684ee8880fdd9ad668fff3 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.033s user 0.012s sys 0.003s
I20240502 01:55:28.035717 25631 ts_tablet_manager.cc:1367] T 119ec541c59f445980a1f04ba3890990 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.000s
I20240502 01:55:28.036275 25635 raft_consensus.cc:348] T 8399bb471a684ee8880fdd9ad668fff3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.036432 25635 raft_consensus.cc:374] T 8399bb471a684ee8880fdd9ad668fff3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.036320 25631 raft_consensus.cc:348] T 119ec541c59f445980a1f04ba3890990 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.036530 25635 raft_consensus.cc:729] T 8399bb471a684ee8880fdd9ad668fff3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.036557 25631 raft_consensus.cc:374] T 119ec541c59f445980a1f04ba3890990 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.036633 25631 raft_consensus.cc:729] T 119ec541c59f445980a1f04ba3890990 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.036715 25635 consensus_queue.cc:260] T 8399bb471a684ee8880fdd9ad668fff3 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.036864 25631 consensus_queue.cc:260] T 119ec541c59f445980a1f04ba3890990 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.037192 25635 ts_tablet_manager.cc:1398] T 8399bb471a684ee8880fdd9ad668fff3 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:28.037325 25631 ts_tablet_manager.cc:1398] T 119ec541c59f445980a1f04ba3890990 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:28.037554 25635 tablet_bootstrap.cc:492] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.037770 25633 raft_consensus.cc:504] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.038349 25631 tablet_bootstrap.cc:492] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.038753 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea9ec0f8b8514c50b369b7e89182da95" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.039160 25441 raft_consensus.cc:3037] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.039547 25631 tablet_bootstrap.cc:654] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.040926 25633 leader_election.cc:288] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.041224 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea9ec0f8b8514c50b369b7e89182da95" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:28.041420 25591 raft_consensus.cc:3037] T ea9ec0f8b8514c50b369b7e89182da95 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.041656 25637 tablet_bootstrap.cc:492] T 45cdd96cf1414bf794042b2d514aa82a P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.041846 25637 ts_tablet_manager.cc:1367] T 45cdd96cf1414bf794042b2d514aa82a P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20240502 01:55:28.041956 25441 raft_consensus.cc:2454] T ea9ec0f8b8514c50b369b7e89182da95 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:28.042300 25483 leader_election.cc:302] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:28.042577 25633 raft_consensus.cc:2781] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.042707 25633 raft_consensus.cc:686] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:28.042989 25633 consensus_queue.cc:237] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.043756 25591 raft_consensus.cc:2454] T ea9ec0f8b8514c50b369b7e89182da95 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:28.044639 25637 raft_consensus.cc:348] T 45cdd96cf1414bf794042b2d514aa82a P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.044853 25637 raft_consensus.cc:374] T 45cdd96cf1414bf794042b2d514aa82a P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.044957 25637 raft_consensus.cc:729] T 45cdd96cf1414bf794042b2d514aa82a P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.045171 25637 consensus_queue.cc:260] T 45cdd96cf1414bf794042b2d514aa82a P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.045711 25637 ts_tablet_manager.cc:1398] T 45cdd96cf1414bf794042b2d514aa82a P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:55:28.045823 25635 tablet_bootstrap.cc:654] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.047044 25635 tablet_bootstrap.cc:492] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.047189 25635 ts_tablet_manager.cc:1367] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20240502 01:55:28.047683 25635 raft_consensus.cc:348] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.047855 25635 raft_consensus.cc:374] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.047936 25635 raft_consensus.cc:729] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.048179 25635 consensus_queue.cc:260] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.048617 25635 ts_tablet_manager.cc:1398] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:55:28.049055 25635 tablet_bootstrap.cc:492] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.050189 25635 tablet_bootstrap.cc:654] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.051548 25637 tablet_bootstrap.cc:492] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.053030 25640 raft_consensus.cc:482] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.053198 25640 raft_consensus.cc:504] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.053757 25640 leader_election.cc:288] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.054316 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "568a8db50f33400992fff1ff0b3f9505" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.054543 25691 raft_consensus.cc:482] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.054728 25691 raft_consensus.cc:504] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
W20240502 01:55:28.054813 25407 leader_election.cc:341] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.054920 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "568a8db50f33400992fff1ff0b3f9505" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.055362 25691 leader_election.cc:288] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
W20240502 01:55:28.055415 25406 leader_election.cc:341] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.055554 25406 leader_election.cc:302] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.056352 25640 raft_consensus.cc:2726] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.056819 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fafad230c13400391bdbba1ac1ee318" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.057027 25441 raft_consensus.cc:2454] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:28.057132 25637 tablet_bootstrap.cc:654] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.057433 25557 leader_election.cc:302] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.057765 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fafad230c13400391bdbba1ac1ee318" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
W20240502 01:55:28.058179 25556 leader_election.cc:341] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.058513 25691 raft_consensus.cc:2781] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.058624 25691 raft_consensus.cc:482] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.058735 25691 raft_consensus.cc:3037] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.060597 25637 tablet_bootstrap.cc:492] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.060772 25637 ts_tablet_manager.cc:1367] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 01:55:28.061384 25637 raft_consensus.cc:348] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.061390 25691 raft_consensus.cc:504] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.061631 25637 raft_consensus.cc:374] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.061718 25637 raft_consensus.cc:729] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.062319 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fafad230c13400391bdbba1ac1ee318" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.062551 25441 raft_consensus.cc:3037] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.064494 25637 consensus_queue.cc:260] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.065224 25441 raft_consensus.cc:2454] T 3fafad230c13400391bdbba1ac1ee318 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.066581 25339 catalog_manager.cc:5484] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.067548 25637 ts_tablet_manager.cc:1398] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240502 01:55:28.069319 25557 leader_election.cc:302] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.069748 25687 raft_consensus.cc:2781] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.069917 25687 raft_consensus.cc:686] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:28.070199 25687 consensus_queue.cc:237] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.070878 25691 leader_election.cc:288] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.072242 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fafad230c13400391bdbba1ac1ee318" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.072464 25633 consensus_queue.cc:1035] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 01:55:28.073168 25556 leader_election.cc:341] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.075451 25640 raft_consensus.cc:482] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.075627 25640 raft_consensus.cc:504] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.075489 25339 catalog_manager.cc:5484] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:28.076208 25640 leader_election.cc:288] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.076932 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c0d4918f3994489a7289728ca82deff" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.077231 25637 tablet_bootstrap.cc:492] T a07dbbae54d745d49344fbaa9fe89f75 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
W20240502 01:55:28.078382 25407 leader_election.cc:341] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.078558 25637 tablet_bootstrap.cc:654] T a07dbbae54d745d49344fbaa9fe89f75 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.078884 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c0d4918f3994489a7289728ca82deff" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
W20240502 01:55:28.079427 25406 leader_election.cc:341] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.079645 25406 leader_election.cc:302] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.081185 25640 raft_consensus.cc:2726] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.081280 25631 tablet_bootstrap.cc:492] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.081493 25631 ts_tablet_manager.cc:1367] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.043s user 0.020s sys 0.022s
I20240502 01:55:28.081607 25633 consensus_queue.cc:1035] T eaabd178eb5f44ae80af982a61550119 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.082221 25631 raft_consensus.cc:348] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.082432 25631 raft_consensus.cc:374] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.082545 25631 raft_consensus.cc:729] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.082782 25631 consensus_queue.cc:260] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.083441 25631 ts_tablet_manager.cc:1398] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:28.083811 25631 tablet_bootstrap.cc:492] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.084846 25637 tablet_bootstrap.cc:492] T a07dbbae54d745d49344fbaa9fe89f75 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.084988 25637 ts_tablet_manager.cc:1367] T a07dbbae54d745d49344fbaa9fe89f75 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 01:55:28.085045 25631 tablet_bootstrap.cc:654] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.085664 25637 raft_consensus.cc:348] T a07dbbae54d745d49344fbaa9fe89f75 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.085875 25637 raft_consensus.cc:374] T a07dbbae54d745d49344fbaa9fe89f75 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.085989 25637 raft_consensus.cc:729] T a07dbbae54d745d49344fbaa9fe89f75 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.086252 25687 raft_consensus.cc:482] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.086215 25637 consensus_queue.cc:260] T a07dbbae54d745d49344fbaa9fe89f75 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.086419 25687 raft_consensus.cc:504] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.086700 25637 ts_tablet_manager.cc:1398] T a07dbbae54d745d49344fbaa9fe89f75 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:28.086961 25637 tablet_bootstrap.cc:492] T 47b72129270d4be3bf173be990d530f3 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.087051 25687 leader_election.cc:288] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.087397 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119ec541c59f445980a1f04ba3890990" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.087623 25440 raft_consensus.cc:2454] T 119ec541c59f445980a1f04ba3890990 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:28.087852 25635 tablet_bootstrap.cc:492] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.088045 25635 ts_tablet_manager.cc:1367] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.029s
I20240502 01:55:28.088239 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119ec541c59f445980a1f04ba3890990" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.088315 25637 tablet_bootstrap.cc:654] T 47b72129270d4be3bf173be990d530f3 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.088428 25517 raft_consensus.cc:2454] T 119ec541c59f445980a1f04ba3890990 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:28.088013 25557 leader_election.cc:302] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.088886 25635 raft_consensus.cc:348] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.089040 25687 raft_consensus.cc:2781] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.089154 25687 raft_consensus.cc:482] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.089267 25687 raft_consensus.cc:3037] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.091667 25687 raft_consensus.cc:504] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.092281 25687 leader_election.cc:288] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.092756 25640 consensus_queue.cc:1035] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.093274 25635 raft_consensus.cc:374] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.093434 25635 raft_consensus.cc:729] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.093711 25635 consensus_queue.cc:260] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.093453 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119ec541c59f445980a1f04ba3890990" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.094403 25440 raft_consensus.cc:3037] T 119ec541c59f445980a1f04ba3890990 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.095049 25635 ts_tablet_manager.cc:1398] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20240502 01:55:28.095363 25635 tablet_bootstrap.cc:492] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.096556 25635 tablet_bootstrap.cc:654] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.100663 25640 consensus_queue.cc:1035] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.093233 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119ec541c59f445980a1f04ba3890990" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.100962 25517 raft_consensus.cc:3037] T 119ec541c59f445980a1f04ba3890990 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.096839 25440 raft_consensus.cc:2454] T 119ec541c59f445980a1f04ba3890990 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.103130 25557 leader_election.cc:302] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.103927 25687 raft_consensus.cc:2781] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.104089 25687 raft_consensus.cc:686] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:28.104228 25517 raft_consensus.cc:2454] T 119ec541c59f445980a1f04ba3890990 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.104332 25687 consensus_queue.cc:237] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.107587 25644 raft_consensus.cc:482] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.107744 25644 raft_consensus.cc:504] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.108374 25644 leader_election.cc:288] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.109117 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "600040d630eb4fa9809d5d477c55dc41" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
W20240502 01:55:28.109556 25556 leader_election.cc:341] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.109869 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "600040d630eb4fa9809d5d477c55dc41" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.110041 25440 raft_consensus.cc:2454] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:28.110383 25557 leader_election.cc:302] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:28.110617 25644 raft_consensus.cc:2781] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.110734 25644 raft_consensus.cc:482] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.110862 25644 raft_consensus.cc:3037] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.114105 25691 raft_consensus.cc:482] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.114322 25644 raft_consensus.cc:504] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.115536 25644 leader_election.cc:288] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.115873 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "600040d630eb4fa9809d5d477c55dc41" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.116058 25440 raft_consensus.cc:3037] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.117998 25691 raft_consensus.cc:504] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.118988 25640 consensus_queue.cc:1035] T 40e8e94fa76d49eebe0a9572ff2b3f12 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240502 01:55:28.121378 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8399bb471a684ee8880fdd9ad668fff3" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.121588 25441 raft_consensus.cc:2454] T 8399bb471a684ee8880fdd9ad668fff3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:28.122287 25514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8399bb471a684ee8880fdd9ad668fff3" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.122496 25514 raft_consensus.cc:2454] T 8399bb471a684ee8880fdd9ad668fff3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:28.122742 25557 leader_election.cc:302] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.127674 25644 raft_consensus.cc:2781] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.127795 25644 raft_consensus.cc:482] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.127911 25644 raft_consensus.cc:3037] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.127703 25440 raft_consensus.cc:2454] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.128490 25557 leader_election.cc:302] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.128772 25680 raft_consensus.cc:2781] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.129545 25640 raft_consensus.cc:482] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.129689 25640 raft_consensus.cc:504] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.130290 25640 leader_election.cc:288] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.131145 25514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62d013793fcb4f2a9fe28d149040f721" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.131361 25514 raft_consensus.cc:2454] T 62d013793fcb4f2a9fe28d149040f721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.131829 25406 leader_election.cc:302] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:28.132108 25640 raft_consensus.cc:2781] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.132225 25640 raft_consensus.cc:482] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.132323 25640 raft_consensus.cc:3037] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.134874 25709 raft_consensus.cc:482] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.135025 25709 raft_consensus.cc:504] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.135599 25709 leader_election.cc:288] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.136193 25514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b44011e7fc24cb085f97afa28a0295f" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.136495 25514 raft_consensus.cc:2454] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.136924 25406 leader_election.cc:302] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:28.137194 25709 raft_consensus.cc:2781] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.137331 25709 raft_consensus.cc:482] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.137429 25709 raft_consensus.cc:3037] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.139744 25710 raft_consensus.cc:482] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.139912 25710 raft_consensus.cc:504] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.139986 25709 raft_consensus.cc:504] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.140482 25710 leader_election.cc:288] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.141144 25588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47b72129270d4be3bf173be990d530f3" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.141258 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62d013793fcb4f2a9fe28d149040f721" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.141456 25589 raft_consensus.cc:2454] T 62d013793fcb4f2a9fe28d149040f721 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.141675 25788 consensus_queue.cc:1035] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.141700 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b44011e7fc24cb085f97afa28a0295f" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.141949 25590 raft_consensus.cc:2454] T 1b44011e7fc24cb085f97afa28a0295f P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.142027 25587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b44011e7fc24cb085f97afa28a0295f" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:28.142218 25587 raft_consensus.cc:3037] T 1b44011e7fc24cb085f97afa28a0295f P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.144834 25587 raft_consensus.cc:2454] T 1b44011e7fc24cb085f97afa28a0295f P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:28.149786 25513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47b72129270d4be3bf173be990d530f3" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.150010 25513 raft_consensus.cc:2454] T 47b72129270d4be3bf173be990d530f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
W20240502 01:55:28.150420 25407 leader_election.cc:341] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.150985 25407 leader_election.cc:302] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.151249 25406 leader_election.cc:302] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.151363 25641 raft_consensus.cc:2781] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.151726 25710 consensus_queue.cc:1035] T 0f960dc60ff5402d8db16edd5ab3cb2d P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.152158 25710 raft_consensus.cc:2781] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.152278 25710 raft_consensus.cc:482] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.152382 25710 raft_consensus.cc:3037] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.155045 25710 raft_consensus.cc:504] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.159251 25710 leader_election.cc:288] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.161929 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47b72129270d4be3bf173be990d530f3" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:28.162643 25407 leader_election.cc:341] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.164033 25587 raft_consensus.cc:3037] T a07dbbae54d745d49344fbaa9fe89f75 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.165410 25514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47b72129270d4be3bf173be990d530f3" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.165604 25514 raft_consensus.cc:3037] T 47b72129270d4be3bf173be990d530f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.166400 25710 consensus_queue.cc:1035] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.169131 25640 raft_consensus.cc:504] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.169725 25640 leader_election.cc:288] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.169929 25640 consensus_queue.cc:1035] T e0276f38a2d94696b6387faa09120883 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.171592 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62d013793fcb4f2a9fe28d149040f721" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:28.171802 25589 raft_consensus.cc:3037] T 62d013793fcb4f2a9fe28d149040f721 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.173548 25513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62d013793fcb4f2a9fe28d149040f721" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.173739 25513 raft_consensus.cc:3037] T 62d013793fcb4f2a9fe28d149040f721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.174405 25589 raft_consensus.cc:2454] T 62d013793fcb4f2a9fe28d149040f721 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:28.174679 25680 raft_consensus.cc:686] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:28.175029 25407 leader_election.cc:302] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.174991 25680 consensus_queue.cc:237] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.176465 25513 raft_consensus.cc:2454] T 62d013793fcb4f2a9fe28d149040f721 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:28.178434 25787 consensus_queue.cc:1035] T f3b9d8250b2e491f8db5bde1649178cf P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.179806 25790 raft_consensus.cc:2781] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.179960 25790 raft_consensus.cc:686] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:28.180241 25790 consensus_queue.cc:237] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.181763 25770 consensus_queue.cc:1035] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.188267 25691 leader_election.cc:288] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.188297 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "600040d630eb4fa9809d5d477c55dc41" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.203069 25691 consensus_queue.cc:1035] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20240502 01:55:28.203555 25514 raft_consensus.cc:2454] T 47b72129270d4be3bf173be990d530f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
W20240502 01:55:28.203903 25556 leader_election.cc:341] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.210218 25709 leader_election.cc:288] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.210348 25788 raft_consensus.cc:482] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.210481 25710 consensus_queue.cc:1035] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20240502 01:55:28.212951 25788 raft_consensus.cc:504] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.214713 25788 leader_election.cc:288] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.214676 25514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f53a683b23346ae963d62ef4c84bee8" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.215631 25644 raft_consensus.cc:504] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.216445 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b44011e7fc24cb085f97afa28a0295f" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.219779 25406 leader_election.cc:302] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.222466 25515 raft_consensus.cc:3037] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.222505 25337 catalog_manager.cc:5484] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:28.223107 25770 consensus_queue.cc:1035] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20240502 01:55:28.233220 25439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8399bb471a684ee8880fdd9ad668fff3" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.233424 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f53a683b23346ae963d62ef4c84bee8" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.235076 25640 raft_consensus.cc:482] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.241174 25514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8399bb471a684ee8880fdd9ad668fff3" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.241393 25514 raft_consensus.cc:3037] T 8399bb471a684ee8880fdd9ad668fff3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.243685 25557 leader_election.cc:302] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:28.244490 25644 leader_election.cc:288] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.247197 25658 raft_consensus.cc:482] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.247392 25658 raft_consensus.cc:504] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.248008 25658 leader_election.cc:288] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.248720 25710 raft_consensus.cc:2781] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.248883 25710 raft_consensus.cc:686] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:28.247156 25770 consensus_queue.cc:1035] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20240502 01:55:28.249871 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45cdd96cf1414bf794042b2d514aa82a" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.250078 25437 raft_consensus.cc:2454] T 45cdd96cf1414bf794042b2d514aa82a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:28.250366 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45cdd96cf1414bf794042b2d514aa82a" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.250548 25586 raft_consensus.cc:2454] T 45cdd96cf1414bf794042b2d514aa82a P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:28.251078 25483 leader_election.cc:302] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.251358 25770 raft_consensus.cc:482] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.251515 25770 raft_consensus.cc:504] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.252137 25770 leader_election.cc:288] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.252338 25770 raft_consensus.cc:2781] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.252457 25770 raft_consensus.cc:482] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.252573 25770 raft_consensus.cc:3037] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.255297 25788 consensus_queue.cc:1035] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20240502 01:55:28.255858 25687 raft_consensus.cc:2726] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.255820 25640 raft_consensus.cc:504] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.256242 25658 raft_consensus.cc:482] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.256279 25710 consensus_queue.cc:237] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.256420 25658 raft_consensus.cc:504] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.256978 25658 leader_election.cc:288] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.256424 25640 leader_election.cc:288] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.257292 25439 raft_consensus.cc:3037] T 8399bb471a684ee8880fdd9ad668fff3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.258047 25770 raft_consensus.cc:504] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.258055 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03251bf1c560469880b1ab407d24a810" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:28.259181 25483 leader_election.cc:341] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.260120 25439 raft_consensus.cc:2454] T 8399bb471a684ee8880fdd9ad668fff3 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.260360 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45cdd96cf1414bf794042b2d514aa82a" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:28.260571 25586 raft_consensus.cc:3037] T 45cdd96cf1414bf794042b2d514aa82a P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.262470 25641 raft_consensus.cc:686] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:28.262984 25641 consensus_queue.cc:237] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.263759 25770 leader_election.cc:288] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.263487 25586 raft_consensus.cc:2454] T 45cdd96cf1414bf794042b2d514aa82a P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:28.264200 25483 leader_election.cc:302] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.264469 25770 raft_consensus.cc:2781] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.264855 25770 raft_consensus.cc:686] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:28.265105 25770 consensus_queue.cc:237] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.267249 25788 consensus_queue.cc:1035] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.268163 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa192ac75ca4897be4bed9594502e7b" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.269001 25635 tablet_bootstrap.cc:492] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.269191 25635 ts_tablet_manager.cc:1367] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.174s user 0.008s sys 0.037s
I20240502 01:55:28.269562 25557 leader_election.cc:302] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.269865 25788 raft_consensus.cc:2781] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.270000 25788 raft_consensus.cc:686] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:28.270269 25788 consensus_queue.cc:237] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.271835 25635 raft_consensus.cc:348] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.272076 25635 raft_consensus.cc:374] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.272174 25635 raft_consensus.cc:729] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.272799 25631 tablet_bootstrap.cc:492] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.272987 25631 ts_tablet_manager.cc:1367] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.189s user 0.076s sys 0.045s
I20240502 01:55:28.273589 25631 raft_consensus.cc:348] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.273813 25631 raft_consensus.cc:374] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.273906 25631 raft_consensus.cc:729] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.275053 25635 consensus_queue.cc:260] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.275602 25635 ts_tablet_manager.cc:1398] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20240502 01:55:28.275939 25635 tablet_bootstrap.cc:492] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.277357 25635 tablet_bootstrap.cc:654] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.277915 25631 consensus_queue.cc:260] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.278528 25631 ts_tablet_manager.cc:1398] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240502 01:55:28.278882 25631 tablet_bootstrap.cc:492] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.280431 25691 consensus_queue.cc:1035] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.281059 25691 consensus_queue.cc:1035] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 01:55:28.283299 25406 leader_election.cc:341] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.283377 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa192ac75ca4897be4bed9594502e7b" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.283762 25687 consensus_queue.cc:1035] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.284467 25640 consensus_queue.cc:1035] T a07dbbae54d745d49344fbaa9fe89f75 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 01:55:28.285303 25407 leader_election.cc:341] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.285456 25407 leader_election.cc:302] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.285678 25640 raft_consensus.cc:2726] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.289952 25515 raft_consensus.cc:2454] T 1b44011e7fc24cb085f97afa28a0295f P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:28.296557 25514 raft_consensus.cc:2454] T 8399bb471a684ee8880fdd9ad668fff3 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.296952 25803 consensus_queue.cc:1035] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20240502 01:55:28.298645 25586 raft_consensus.cc:3037] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.299594 25637 tablet_bootstrap.cc:492] T 47b72129270d4be3bf173be990d530f3 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.301409 25439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03251bf1c560469880b1ab407d24a810" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.301471 25441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9855b1e8274e49a57434e6151b8e70" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.301613 25439 raft_consensus.cc:2454] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
W20240502 01:55:28.302500 25483 leader_election.cc:341] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.302757 25483 leader_election.cc:302] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.303387 25718 raft_consensus.cc:2781] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.303490 25718 raft_consensus.cc:482] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.303604 25718 raft_consensus.cc:3037] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.304067 25631 tablet_bootstrap.cc:654] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.308459 25718 raft_consensus.cc:504] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.309091 25718 leader_election.cc:288] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.311039 25337 catalog_manager.cc:5484] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.313588 25709 consensus_queue.cc:1035] T ef2c1bf82b7f4e5f8e079a9502e236b0 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.315246 25588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03251bf1c560469880b1ab407d24a810" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:28.315773 25483 leader_election.cc:341] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.300516 25513 raft_consensus.cc:1226] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 2 FOLLOWER]: Rejecting Update request from peer 481341cc6302403dab5dcc402f42a81f for earlier term 1. Current term is 2. Ops: []
I20240502 01:55:28.322481 25436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45cdd96cf1414bf794042b2d514aa82a" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.322733 25436 raft_consensus.cc:3037] T 45cdd96cf1414bf794042b2d514aa82a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.325747 25436 raft_consensus.cc:2454] T 45cdd96cf1414bf794042b2d514aa82a P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:28.327100 25436 raft_consensus.cc:3037] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.336234 25718 raft_consensus.cc:482] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.336606 25787 consensus_queue.cc:1035] T 082a20c28ee243268963c85be001faa7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.336735 25788 consensus_queue.cc:1035] T 34fff5148ef24f36b798374c1bfc6f69 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.339056 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9855b1e8274e49a57434e6151b8e70" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.339453 25805 consensus_queue.cc:1046] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20240502 01:55:28.339823 25805 raft_consensus.cc:3032] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:55:28.340006 25805 raft_consensus.cc:729] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:28.340407 25805 consensus_queue.cc:260] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.340580 25633 consensus_queue.cc:1035] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.341042 25805 raft_consensus.cc:3037] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Advancing to term 2
W20240502 01:55:28.341205 25483 leader_election.cc:341] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.341356 25483 leader_election.cc:302] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9; no voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.342029 25633 raft_consensus.cc:2726] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.346587 25788 consensus_queue.cc:1035] T c74d58e57f044068af88fcb359615ada P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.347450 25637 ts_tablet_manager.cc:1367] T 47b72129270d4be3bf173be990d530f3 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.213s user 0.006s sys 0.048s
I20240502 01:55:28.348320 25637 raft_consensus.cc:348] T 47b72129270d4be3bf173be990d530f3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.348701 25680 consensus_queue.cc:1035] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20240502 01:55:28.349267 25337 catalog_manager.cc:5484] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.350257 25635 tablet_bootstrap.cc:492] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.350422 25635 ts_tablet_manager.cc:1367] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.075s user 0.004s sys 0.010s
I20240502 01:55:28.351182 25635 raft_consensus.cc:348] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.351379 25635 raft_consensus.cc:374] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.351478 25635 raft_consensus.cc:729] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.351737 25635 consensus_queue.cc:260] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.352293 25635 ts_tablet_manager.cc:1398] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:28.352614 25635 tablet_bootstrap.cc:492] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.353967 25635 tablet_bootstrap.cc:654] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.354669 25718 raft_consensus.cc:504] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.355273 25718 leader_election.cc:288] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.355468 25637 raft_consensus.cc:374] T 47b72129270d4be3bf173be990d530f3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.355579 25637 raft_consensus.cc:729] T 47b72129270d4be3bf173be990d530f3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.355657 25436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f64edf93e440f9b455caa1fcc9f3a4" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.355711 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10f64edf93e440f9b455caa1fcc9f3a4" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.355883 25436 raft_consensus.cc:2379] T 10f64edf93e440f9b455caa1fcc9f3a4 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c36b03bf7c42a9a430cc595953aff9 in current term 1: Already voted for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in this term.
I20240502 01:55:28.355880 25637 consensus_queue.cc:260] T 47b72129270d4be3bf173be990d530f3 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.356513 25483 leader_election.cc:302] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9; no voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.356578 25637 ts_tablet_manager.cc:1398] T 47b72129270d4be3bf173be990d530f3 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20240502 01:55:28.356972 25637 tablet_bootstrap.cc:492] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.357707 25635 tablet_bootstrap.cc:492] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.357807 25770 raft_consensus.cc:3037] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.357919 25635 ts_tablet_manager.cc:1367] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:55:28.358603 25637 tablet_bootstrap.cc:654] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.358582 25635 raft_consensus.cc:348] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.358868 25635 raft_consensus.cc:374] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.358961 25635 raft_consensus.cc:729] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.359194 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03251bf1c560469880b1ab407d24a810" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.359395 25437 raft_consensus.cc:3037] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.360725 25770 raft_consensus.cc:2726] T 10f64edf93e440f9b455caa1fcc9f3a4 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.361138 25635 consensus_queue.cc:260] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.362563 25635 ts_tablet_manager.cc:1398] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240502 01:55:28.363245 25339 catalog_manager.cc:5484] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:28.364084 25339 catalog_manager.cc:5484] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:28.367237 25641 raft_consensus.cc:482] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.367520 25641 raft_consensus.cc:504] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.372903 25635 tablet_bootstrap.cc:492] T cda8a639a1914915a2caaf8362fe2643 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.377795 25641 leader_election.cc:288] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.379109 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6adb7e9b9fa4b858ce0f42b8416cc3c" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.380154 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6adb7e9b9fa4b858ce0f42b8416cc3c" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.380558 25631 tablet_bootstrap.cc:492] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
W20240502 01:55:28.380641 25407 leader_election.cc:341] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.380719 25631 ts_tablet_manager.cc:1367] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.102s user 0.004s sys 0.032s
I20240502 01:55:28.381625 25631 raft_consensus.cc:348] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.381850 25631 raft_consensus.cc:374] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.382045 25631 raft_consensus.cc:729] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.382272 25631 consensus_queue.cc:260] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.382967 25631 ts_tablet_manager.cc:1398] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:28.383267 25631 tablet_bootstrap.cc:492] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.384764 25631 tablet_bootstrap.cc:654] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
W20240502 01:55:28.389427 25406 leader_election.cc:341] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.389654 25406 leader_election.cc:302] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.389943 25641 raft_consensus.cc:2726] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.394059 25631 tablet_bootstrap.cc:492] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.394233 25631 ts_tablet_manager.cc:1367] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
I20240502 01:55:28.394934 25637 tablet_bootstrap.cc:492] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.394901 25631 raft_consensus.cc:348] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.395166 25631 raft_consensus.cc:374] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.395191 25637 ts_tablet_manager.cc:1367] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.011s
I20240502 01:55:28.395254 25631 raft_consensus.cc:729] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.395579 25631 consensus_queue.cc:260] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.395668 25337 catalog_manager.cc:5484] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.396160 25637 raft_consensus.cc:348] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.396450 25637 raft_consensus.cc:374] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.396600 25637 raft_consensus.cc:729] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.396867 25637 consensus_queue.cc:260] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.398075 25637 ts_tablet_manager.cc:1398] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:55:28.396273 25337 catalog_manager.cc:5484] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.396169 25631 ts_tablet_manager.cc:1398] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:28.399439 25631 tablet_bootstrap.cc:492] T 3fafad230c13400391bdbba1ac1ee318 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.400772 25631 tablet_bootstrap.cc:654] T 3fafad230c13400391bdbba1ac1ee318 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.401439 25437 raft_consensus.cc:2454] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:28.397665 25635 tablet_bootstrap.cc:654] T cda8a639a1914915a2caaf8362fe2643 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.401870 25483 leader_election.cc:302] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.402248 25633 raft_consensus.cc:2781] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.402432 25633 raft_consensus.cc:686] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:28.402493 25637 tablet_bootstrap.cc:492] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.402712 25633 consensus_queue.cc:237] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.403800 25637 tablet_bootstrap.cc:654] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.408962 25631 tablet_bootstrap.cc:492] T 3fafad230c13400391bdbba1ac1ee318 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.409099 25631 ts_tablet_manager.cc:1367] T 3fafad230c13400391bdbba1ac1ee318 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.003s
I20240502 01:55:28.409623 25631 raft_consensus.cc:348] T 3fafad230c13400391bdbba1ac1ee318 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.409770 25631 raft_consensus.cc:374] T 3fafad230c13400391bdbba1ac1ee318 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.409875 25631 raft_consensus.cc:729] T 3fafad230c13400391bdbba1ac1ee318 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.410055 25631 consensus_queue.cc:260] T 3fafad230c13400391bdbba1ac1ee318 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.410552 25631 ts_tablet_manager.cc:1398] T 3fafad230c13400391bdbba1ac1ee318 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:28.410864 25631 tablet_bootstrap.cc:492] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.411770 25635 tablet_bootstrap.cc:492] T cda8a639a1914915a2caaf8362fe2643 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.411608 25337 catalog_manager.cc:5484] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.411916 25635 ts_tablet_manager.cc:1367] T cda8a639a1914915a2caaf8362fe2643 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20240502 01:55:28.412035 25631 tablet_bootstrap.cc:654] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.412629 25635 raft_consensus.cc:348] T cda8a639a1914915a2caaf8362fe2643 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.412829 25635 raft_consensus.cc:374] T cda8a639a1914915a2caaf8362fe2643 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.412935 25635 raft_consensus.cc:729] T cda8a639a1914915a2caaf8362fe2643 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.413151 25635 consensus_queue.cc:260] T cda8a639a1914915a2caaf8362fe2643 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.413465 25637 tablet_bootstrap.cc:492] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.413623 25637 ts_tablet_manager.cc:1367] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20240502 01:55:28.413736 25635 ts_tablet_manager.cc:1398] T cda8a639a1914915a2caaf8362fe2643 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:28.414069 25635 tablet_bootstrap.cc:492] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.414261 25637 raft_consensus.cc:348] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.414461 25637 raft_consensus.cc:374] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.414543 25637 raft_consensus.cc:729] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.414809 25637 consensus_queue.cc:260] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.415334 25637 ts_tablet_manager.cc:1398] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:55:28.415460 25635 tablet_bootstrap.cc:654] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.416687 25637 tablet_bootstrap.cc:492] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.417587 25631 tablet_bootstrap.cc:492] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.417742 25631 ts_tablet_manager.cc:1367] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20240502 01:55:28.418020 25637 tablet_bootstrap.cc:654] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.418520 25631 raft_consensus.cc:348] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.418745 25631 raft_consensus.cc:374] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.418818 25631 raft_consensus.cc:729] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.419102 25631 consensus_queue.cc:260] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.420272 25631 ts_tablet_manager.cc:1398] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:28.420603 25631 tablet_bootstrap.cc:492] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.421880 25687 raft_consensus.cc:482] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.421927 25631 tablet_bootstrap.cc:654] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.422049 25687 raft_consensus.cc:504] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.422691 25687 leader_election.cc:288] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.423132 25514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa192ac75ca4897be4bed9594502e7b" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.423197 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa192ac75ca4897be4bed9594502e7b" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.423373 25514 raft_consensus.cc:2454] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:28.423404 25437 raft_consensus.cc:2454] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:28.423763 25556 leader_election.cc:302] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.424217 25687 raft_consensus.cc:2781] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.424347 25687 raft_consensus.cc:482] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.424434 25687 raft_consensus.cc:3037] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.426514 25710 raft_consensus.cc:482] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.426697 25710 raft_consensus.cc:504] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.427346 25710 leader_election.cc:288] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.427736 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adfecdabe3c04439bddacefd7be19242" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.428123 25514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adfecdabe3c04439bddacefd7be19242" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
W20240502 01:55:28.428591 25406 leader_election.cc:341] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
W20240502 01:55:28.428772 25407 leader_election.cc:341] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.428879 25407 leader_election.cc:302] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.429270 25710 raft_consensus.cc:2726] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.429315 25687 raft_consensus.cc:504] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.430145 25635 tablet_bootstrap.cc:492] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.430171 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa192ac75ca4897be4bed9594502e7b" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.430320 25635 ts_tablet_manager.cc:1367] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.007s
I20240502 01:55:28.430366 25437 raft_consensus.cc:3037] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.431066 25635 raft_consensus.cc:348] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.431300 25635 raft_consensus.cc:374] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.431433 25635 raft_consensus.cc:729] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.431686 25635 consensus_queue.cc:260] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.431349 25637 tablet_bootstrap.cc:492] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.432020 25637 ts_tablet_manager.cc:1367] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.009s
I20240502 01:55:28.432669 25637 raft_consensus.cc:348] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.432880 25637 raft_consensus.cc:374] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.432993 25637 raft_consensus.cc:729] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.433053 25437 raft_consensus.cc:2454] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.433214 25637 consensus_queue.cc:260] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.433463 25557 leader_election.cc:302] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.433727 25637 ts_tablet_manager.cc:1398] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 01:55:28.433822 25787 raft_consensus.cc:2781] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.433996 25637 tablet_bootstrap.cc:492] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.433960 25787 raft_consensus.cc:686] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:28.434279 25787 consensus_queue.cc:237] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.435266 25637 tablet_bootstrap.cc:654] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.436070 25514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa192ac75ca4897be4bed9594502e7b" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.436262 25514 raft_consensus.cc:3037] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.436424 25635 ts_tablet_manager.cc:1398] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240502 01:55:28.436699 25635 tablet_bootstrap.cc:492] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.438230 25635 tablet_bootstrap.cc:654] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.438905 25514 raft_consensus.cc:2454] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.439430 25687 leader_election.cc:288] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.440511 25631 tablet_bootstrap.cc:492] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.440649 25631 ts_tablet_manager.cc:1367] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.001s
I20240502 01:55:28.441006 25635 tablet_bootstrap.cc:492] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.441161 25635 ts_tablet_manager.cc:1367] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:55:28.441367 25631 raft_consensus.cc:348] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.441569 25631 raft_consensus.cc:374] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.441423 25339 catalog_manager.cc:5484] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:28.441668 25631 raft_consensus.cc:729] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.441910 25631 consensus_queue.cc:260] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.441957 25635 raft_consensus.cc:348] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.442171 25635 raft_consensus.cc:374] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.442281 25635 raft_consensus.cc:729] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.442548 25631 ts_tablet_manager.cc:1398] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:28.442546 25635 consensus_queue.cc:260] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.442919 25631 tablet_bootstrap.cc:492] T 4fab7be12223417a873e8747bb4ce8fd P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.443171 25635 ts_tablet_manager.cc:1398] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:28.443452 25635 tablet_bootstrap.cc:492] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.442915 25637 tablet_bootstrap.cc:492] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.444444 25637 ts_tablet_manager.cc:1367] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20240502 01:55:28.444998 25635 tablet_bootstrap.cc:654] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.445127 25637 raft_consensus.cc:348] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.445334 25637 raft_consensus.cc:374] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.445415 25637 raft_consensus.cc:729] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.445727 25637 consensus_queue.cc:260] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.446321 25637 ts_tablet_manager.cc:1398] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:28.449898 25635 tablet_bootstrap.cc:492] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.450017 25635 ts_tablet_manager.cc:1367] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20240502 01:55:28.450598 25635 raft_consensus.cc:348] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.450752 25635 raft_consensus.cc:374] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.450798 25635 raft_consensus.cc:729] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.450987 25635 consensus_queue.cc:260] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.451404 25635 ts_tablet_manager.cc:1398] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:55:28.451743 25635 tablet_bootstrap.cc:492] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.452869 25635 tablet_bootstrap.cc:654] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.453251 25637 tablet_bootstrap.cc:492] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.453918 25631 tablet_bootstrap.cc:654] T 4fab7be12223417a873e8747bb4ce8fd P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.456888 25635 tablet_bootstrap.cc:492] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.456996 25637 tablet_bootstrap.cc:654] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.457012 25635 ts_tablet_manager.cc:1367] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20240502 01:55:28.457603 25635 raft_consensus.cc:348] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.457767 25635 raft_consensus.cc:374] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.457829 25635 raft_consensus.cc:729] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.458048 25635 consensus_queue.cc:260] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.458412 25635 ts_tablet_manager.cc:1398] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 01:55:28.458730 25635 tablet_bootstrap.cc:492] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.459107 25631 tablet_bootstrap.cc:492] T 4fab7be12223417a873e8747bb4ce8fd P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.459214 25631 ts_tablet_manager.cc:1367] T 4fab7be12223417a873e8747bb4ce8fd P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.002s
I20240502 01:55:28.459811 25631 raft_consensus.cc:348] T 4fab7be12223417a873e8747bb4ce8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.459970 25631 raft_consensus.cc:374] T 4fab7be12223417a873e8747bb4ce8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.460021 25631 raft_consensus.cc:729] T 4fab7be12223417a873e8747bb4ce8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.460099 25635 tablet_bootstrap.cc:654] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.460222 25631 consensus_queue.cc:260] T 4fab7be12223417a873e8747bb4ce8fd P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
W20240502 01:55:28.461123 25387 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 01:55:28.461575 25631 ts_tablet_manager.cc:1398] T 4fab7be12223417a873e8747bb4ce8fd P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:28.461822 25631 tablet_bootstrap.cc:492] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.462579 25637 tablet_bootstrap.cc:492] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.462751 25637 ts_tablet_manager.cc:1367] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240502 01:55:28.463302 25631 tablet_bootstrap.cc:654] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.463459 25637 raft_consensus.cc:348] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.463691 25637 raft_consensus.cc:374] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.463804 25637 raft_consensus.cc:729] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.464111 25637 consensus_queue.cc:260] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.465572 25637 ts_tablet_manager.cc:1398] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:55:28.465880 25637 tablet_bootstrap.cc:492] T 4fab7be12223417a873e8747bb4ce8fd P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.467480 25637 tablet_bootstrap.cc:654] T 4fab7be12223417a873e8747bb4ce8fd P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.469808 25631 tablet_bootstrap.cc:492] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.469935 25631 ts_tablet_manager.cc:1367] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20240502 01:55:28.470548 25631 raft_consensus.cc:348] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.470726 25631 raft_consensus.cc:374] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.470782 25631 raft_consensus.cc:729] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.470924 25687 raft_consensus.cc:482] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.471007 25631 consensus_queue.cc:260] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.471052 25687 raft_consensus.cc:504] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.471439 25631 ts_tablet_manager.cc:1398] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20240502 01:55:28.471563 25687 leader_election.cc:288] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.472182 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6adb7e9b9fa4b858ce0f42b8416cc3c" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.472358 25437 raft_consensus.cc:2454] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:28.472652 25514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6adb7e9b9fa4b858ce0f42b8416cc3c" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.472759 25557 leader_election.cc:302] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.472805 25514 raft_consensus.cc:2454] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:28.473471 25631 tablet_bootstrap.cc:492] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.473603 25687 raft_consensus.cc:2781] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.473690 25687 raft_consensus.cc:482] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.473757 25687 raft_consensus.cc:3037] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.475886 25631 tablet_bootstrap.cc:654] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.476111 25687 raft_consensus.cc:504] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.476958 25687 leader_election.cc:288] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.477025 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6adb7e9b9fa4b858ce0f42b8416cc3c" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.477181 25437 raft_consensus.cc:3037] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.477447 25635 tablet_bootstrap.cc:492] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.477602 25635 ts_tablet_manager.cc:1367] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.013s
I20240502 01:55:28.478194 25635 raft_consensus.cc:348] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.478363 25635 raft_consensus.cc:374] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.478415 25635 raft_consensus.cc:729] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.478545 25637 tablet_bootstrap.cc:492] T 4fab7be12223417a873e8747bb4ce8fd P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.478659 25637 ts_tablet_manager.cc:1367] T 4fab7be12223417a873e8747bb4ce8fd P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.003s
I20240502 01:55:28.478653 25635 consensus_queue.cc:260] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.479139 25635 ts_tablet_manager.cc:1398] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:55:28.479322 25637 raft_consensus.cc:348] T 4fab7be12223417a873e8747bb4ce8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.479518 25637 raft_consensus.cc:374] T 4fab7be12223417a873e8747bb4ce8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.479568 25637 raft_consensus.cc:729] T 4fab7be12223417a873e8747bb4ce8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.479727 25437 raft_consensus.cc:2454] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.479812 25637 consensus_queue.cc:260] T 4fab7be12223417a873e8747bb4ce8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.480072 25514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6adb7e9b9fa4b858ce0f42b8416cc3c" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.480218 25514 raft_consensus.cc:3037] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.480260 25637 ts_tablet_manager.cc:1398] T 4fab7be12223417a873e8747bb4ce8fd P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:55:28.480540 25637 tablet_bootstrap.cc:492] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.481925 25637 tablet_bootstrap.cc:654] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.482652 25514 raft_consensus.cc:2454] T c6adb7e9b9fa4b858ce0f42b8416cc3c P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.483122 25557 leader_election.cc:302] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.483548 25687 raft_consensus.cc:2781] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.483661 25687 raft_consensus.cc:686] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:28.483886 25687 consensus_queue.cc:237] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.484599 25635 tablet_bootstrap.cc:492] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.486075 25635 tablet_bootstrap.cc:654] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.492177 25631 tablet_bootstrap.cc:492] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.492395 25631 ts_tablet_manager.cc:1367] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.003s
I20240502 01:55:28.493034 25631 raft_consensus.cc:348] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.493434 25631 raft_consensus.cc:374] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.493538 25631 raft_consensus.cc:729] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.493803 25631 consensus_queue.cc:260] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.494437 25631 ts_tablet_manager.cc:1398] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:28.494761 25631 tablet_bootstrap.cc:492] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.496394 25631 tablet_bootstrap.cc:654] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.499888 25710 raft_consensus.cc:482] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.500023 25710 raft_consensus.cc:504] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.500602 25710 leader_election.cc:288] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.501169 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fab7be12223417a873e8747bb4ce8fd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.501336 25589 raft_consensus.cc:2454] T 4fab7be12223417a873e8747bb4ce8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.501689 25407 leader_election.cc:302] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.502115 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fab7be12223417a873e8747bb4ce8fd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.502271 25515 raft_consensus.cc:2454] T 4fab7be12223417a873e8747bb4ce8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.503185 25710 raft_consensus.cc:2781] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.503275 25710 raft_consensus.cc:482] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.503342 25710 raft_consensus.cc:3037] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.505906 25710 raft_consensus.cc:504] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.506273 25631 tablet_bootstrap.cc:492] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.506438 25631 ts_tablet_manager.cc:1367] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20240502 01:55:28.506755 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fab7be12223417a873e8747bb4ce8fd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.506963 25515 raft_consensus.cc:3037] T 4fab7be12223417a873e8747bb4ce8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.507252 25631 raft_consensus.cc:348] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.507506 25631 raft_consensus.cc:374] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.507604 25631 raft_consensus.cc:729] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.507887 25631 consensus_queue.cc:260] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.508495 25631 ts_tablet_manager.cc:1398] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:28.508793 25631 tablet_bootstrap.cc:492] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.510360 25515 raft_consensus.cc:2454] T 4fab7be12223417a873e8747bb4ce8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:28.510561 25631 tablet_bootstrap.cc:654] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.512451 25406 leader_election.cc:302] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:28.512689 25641 raft_consensus.cc:482] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.512804 25641 raft_consensus.cc:504] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.513346 25641 leader_election.cc:288] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.513484 25641 raft_consensus.cc:2781] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.513605 25641 raft_consensus.cc:686] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:28.513819 25641 consensus_queue.cc:237] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.515156 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "feaebca58bd448eb8769581e94dd493c" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.515491 25787 consensus_queue.cc:1035] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 01:55:28.516132 25407 leader_election.cc:341] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.519666 25631 tablet_bootstrap.cc:492] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.519865 25631 ts_tablet_manager.cc:1367] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20240502 01:55:28.520540 25631 raft_consensus.cc:348] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.520773 25631 raft_consensus.cc:374] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.520877 25631 raft_consensus.cc:729] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.520995 25787 consensus_queue.cc:1035] T 119ec541c59f445980a1f04ba3890990 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.521220 25631 consensus_queue.cc:260] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.521833 25631 ts_tablet_manager.cc:1398] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:28.522136 25631 tablet_bootstrap.cc:492] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.523900 25631 tablet_bootstrap.cc:654] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.526602 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "feaebca58bd448eb8769581e94dd493c" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.526793 25515 raft_consensus.cc:2454] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.528595 25406 leader_election.cc:302] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.529001 25805 raft_consensus.cc:2781] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.529076 25805 raft_consensus.cc:482] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.529132 25805 raft_consensus.cc:3037] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.531761 25805 raft_consensus.cc:504] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.532359 25805 leader_election.cc:288] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.532881 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "feaebca58bd448eb8769581e94dd493c" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:28.533347 25407 leader_election.cc:341] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.534361 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "feaebca58bd448eb8769581e94dd493c" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.534525 25515 raft_consensus.cc:3037] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.535391 25710 leader_election.cc:288] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.535775 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fab7be12223417a873e8747bb4ce8fd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:28.535944 25589 raft_consensus.cc:3037] T 4fab7be12223417a873e8747bb4ce8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.536608 25631 tablet_bootstrap.cc:492] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.536799 25631 ts_tablet_manager.cc:1367] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.004s
I20240502 01:55:28.537493 25631 raft_consensus.cc:348] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.537819 25631 raft_consensus.cc:374] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.537925 25631 raft_consensus.cc:729] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.538192 25631 consensus_queue.cc:260] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.538697 25631 ts_tablet_manager.cc:1398] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:28.539050 25631 tablet_bootstrap.cc:492] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.538643 25589 raft_consensus.cc:2454] T 4fab7be12223417a873e8747bb4ce8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:28.540766 25631 tablet_bootstrap.cc:654] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.546164 25515 raft_consensus.cc:2454] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:28.546514 25406 leader_election.cc:302] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.546975 25710 raft_consensus.cc:2781] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.547101 25710 raft_consensus.cc:686] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:28.547318 25710 consensus_queue.cc:237] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.553042 25680 consensus_queue.cc:1035] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.553539 25631 tablet_bootstrap.cc:492] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.553707 25631 ts_tablet_manager.cc:1367] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.000s
I20240502 01:55:28.554366 25631 raft_consensus.cc:348] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.554636 25631 raft_consensus.cc:374] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.554730 25631 raft_consensus.cc:729] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.555064 25631 consensus_queue.cc:260] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.555601 25631 ts_tablet_manager.cc:1398] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:55:28.555956 25631 tablet_bootstrap.cc:492] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.557427 25631 tablet_bootstrap.cc:654] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.568264 25631 tablet_bootstrap.cc:492] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.568852 25631 ts_tablet_manager.cc:1367] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.008s
I20240502 01:55:28.569562 25631 raft_consensus.cc:348] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.569783 25631 raft_consensus.cc:374] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.569900 25631 raft_consensus.cc:729] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.570163 25631 consensus_queue.cc:260] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.570926 25631 ts_tablet_manager.cc:1398] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:55:28.571225 25631 tablet_bootstrap.cc:492] T 35d2910628774d18af9b616272b05260 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.571741 25680 raft_consensus.cc:482] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.571887 25680 raft_consensus.cc:504] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.572521 25680 leader_election.cc:288] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.573202 25633 raft_consensus.cc:482] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.573323 25633 raft_consensus.cc:504] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.573397 25436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9855b1e8274e49a57434e6151b8e70" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.573603 25436 raft_consensus.cc:2454] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:28.573922 25633 leader_election.cc:288] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.573989 25557 leader_election.cc:302] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.574241 25680 raft_consensus.cc:2781] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.574313 25680 raft_consensus.cc:482] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.574368 25680 raft_consensus.cc:3037] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.575071 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "600040d630eb4fa9809d5d477c55dc41" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.575291 25440 raft_consensus.cc:2379] T 600040d630eb4fa9809d5d477c55dc41 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77c36b03bf7c42a9a430cc595953aff9 in current term 1: Already voted for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in this term.
I20240502 01:55:28.576252 25770 consensus_queue.cc:1035] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.577085 25680 raft_consensus.cc:504] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.577662 25680 leader_election.cc:288] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.578163 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9855b1e8274e49a57434e6151b8e70" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.578351 25440 raft_consensus.cc:3037] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.578625 25631 tablet_bootstrap.cc:654] T 35d2910628774d18af9b616272b05260 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.580895 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9855b1e8274e49a57434e6151b8e70" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.581063 25512 raft_consensus.cc:3037] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.583349 25718 consensus_queue.cc:1035] T ea9ec0f8b8514c50b369b7e89182da95 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.583658 25512 raft_consensus.cc:2454] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.584087 25556 leader_election.cc:302] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.584116 25440 raft_consensus.cc:2454] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.585170 25788 raft_consensus.cc:2781] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.585299 25788 raft_consensus.cc:686] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:28.585523 25788 consensus_queue.cc:237] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.586508 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "600040d630eb4fa9809d5d477c55dc41" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.586963 25483 leader_election.cc:302] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9; no voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.587373 25658 raft_consensus.cc:3037] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.589859 25658 raft_consensus.cc:2726] T 600040d630eb4fa9809d5d477c55dc41 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.592558 25787 consensus_queue.cc:1035] T 10f64edf93e440f9b455caa1fcc9f3a4 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.593422 25631 tablet_bootstrap.cc:492] T 35d2910628774d18af9b616272b05260 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.593611 25631 ts_tablet_manager.cc:1367] T 35d2910628774d18af9b616272b05260 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.007s
I20240502 01:55:28.594481 25631 raft_consensus.cc:348] T 35d2910628774d18af9b616272b05260 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.594722 25631 raft_consensus.cc:374] T 35d2910628774d18af9b616272b05260 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.594846 25631 raft_consensus.cc:729] T 35d2910628774d18af9b616272b05260 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.595104 25631 consensus_queue.cc:260] T 35d2910628774d18af9b616272b05260 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.595666 25631 ts_tablet_manager.cc:1398] T 35d2910628774d18af9b616272b05260 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:28.595975 25631 tablet_bootstrap.cc:492] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.597576 25631 tablet_bootstrap.cc:654] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.598788 25680 consensus_queue.cc:1035] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.573374 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c9855b1e8274e49a57434e6151b8e70" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.600374 25515 raft_consensus.cc:2362] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1. Re-sending same reply.
I20240502 01:55:28.603230 25512 raft_consensus.cc:3037] T 3fafad230c13400391bdbba1ac1ee318 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.606047 25631 tablet_bootstrap.cc:492] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.606241 25631 ts_tablet_manager.cc:1367] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20240502 01:55:28.606449 25793 consensus_queue.cc:1035] T 3fafad230c13400391bdbba1ac1ee318 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.607095 25631 raft_consensus.cc:348] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.607357 25631 raft_consensus.cc:374] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.607478 25631 raft_consensus.cc:729] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.607748 25631 consensus_queue.cc:260] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.608439 25631 ts_tablet_manager.cc:1398] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:28.608749 25631 tablet_bootstrap.cc:492] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.610374 25631 tablet_bootstrap.cc:654] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.641050 25710 raft_consensus.cc:482] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.641185 25710 raft_consensus.cc:504] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.642150 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d2910628774d18af9b616272b05260" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:28.642589 25407 leader_election.cc:341] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.642752 25710 leader_election.cc:288] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.642957 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d2910628774d18af9b616272b05260" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.643270 25512 raft_consensus.cc:2454] T 35d2910628774d18af9b616272b05260 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.643589 25406 leader_election.cc:302] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.643103 25680 raft_consensus.cc:482] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.644047 25680 raft_consensus.cc:504] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.644840 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "568a8db50f33400992fff1ff0b3f9505" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.645026 25440 raft_consensus.cc:2454] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 0.
I20240502 01:55:28.645372 25557 leader_election.cc:302] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.645633 25793 raft_consensus.cc:2781] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.645705 25793 raft_consensus.cc:482] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.645773 25793 raft_consensus.cc:3037] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.648568 25793 raft_consensus.cc:504] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.649488 25793 leader_election.cc:288] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.650022 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "568a8db50f33400992fff1ff0b3f9505" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.650187 25440 raft_consensus.cc:3037] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.650522 25709 raft_consensus.cc:2781] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.650600 25709 raft_consensus.cc:482] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.650661 25709 raft_consensus.cc:3037] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.652851 25440 raft_consensus.cc:2454] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.653187 25557 leader_election.cc:302] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.653429 25792 raft_consensus.cc:482] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.653544 25792 raft_consensus.cc:504] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.654119 25792 leader_election.cc:288] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.654273 25792 raft_consensus.cc:2781] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.654388 25792 raft_consensus.cc:686] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Becoming Leader. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Running, Role: LEADER
I20240502 01:55:28.654623 25792 consensus_queue.cc:237] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.655999 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03251bf1c560469880b1ab407d24a810" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.656379 25436 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03251bf1c560469880b1ab407d24a810" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.656598 25436 raft_consensus.cc:2379] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 77c36b03bf7c42a9a430cc595953aff9 in this term.
I20240502 01:55:28.656992 25557 leader_election.cc:302] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:28.657348 25787 raft_consensus.cc:3037] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.660259 25787 raft_consensus.cc:2726] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.653141 25709 raft_consensus.cc:504] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.660939 25709 leader_election.cc:288] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.661684 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d2910628774d18af9b616272b05260" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.661834 25515 raft_consensus.cc:3037] T 35d2910628774d18af9b616272b05260 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.661936 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d2910628774d18af9b616272b05260" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:28.662364 25407 leader_election.cc:341] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.663210 25709 consensus_queue.cc:1035] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.664397 25515 raft_consensus.cc:2454] T 35d2910628774d18af9b616272b05260 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:28.665002 25406 leader_election.cc:302] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.665356 25709 raft_consensus.cc:2781] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.665544 25709 raft_consensus.cc:686] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:28.665782 25709 consensus_queue.cc:237] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.669930 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "568a8db50f33400992fff1ff0b3f9505" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.670094 25512 raft_consensus.cc:3037] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.672782 25512 raft_consensus.cc:2454] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1.
I20240502 01:55:28.674023 25680 leader_election.cc:288] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.674216 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "568a8db50f33400992fff1ff0b3f9505" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.674361 25515 raft_consensus.cc:2362] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a7ffa3e1ba614911a5fc9fafc38573f1 in term 1. Re-sending same reply.
I20240502 01:55:28.680022 25658 raft_consensus.cc:482] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.680150 25658 raft_consensus.cc:504] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.680671 25658 leader_election.cc:288] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.681412 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cacbe419b1480f9ea528e3a31c32f3" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:28.681914 25483 leader_election.cc:341] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.682076 25590 raft_consensus.cc:3037] T 47b72129270d4be3bf173be990d530f3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.682186 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cacbe419b1480f9ea528e3a31c32f3" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
W20240502 01:55:28.682695 25483 leader_election.cc:341] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.682801 25483 leader_election.cc:302] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9; no voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.683256 25658 raft_consensus.cc:2726] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.685487 25803 consensus_queue.cc:1035] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.689224 25658 raft_consensus.cc:482] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.689389 25658 raft_consensus.cc:504] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.689941 25658 leader_election.cc:288] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.690688 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cda8a639a1914915a2caaf8362fe2643" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.690688 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cda8a639a1914915a2caaf8362fe2643" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.690887 25440 raft_consensus.cc:2454] T cda8a639a1914915a2caaf8362fe2643 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
W20240502 01:55:28.691182 25483 leader_election.cc:341] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.691368 25483 leader_election.cc:302] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.691573 25658 raft_consensus.cc:2781] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.691653 25658 raft_consensus.cc:482] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.691711 25658 raft_consensus.cc:3037] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.693936 25338 catalog_manager.cc:5484] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.694473 25658 raft_consensus.cc:504] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.696837 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cda8a639a1914915a2caaf8362fe2643" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.697008 25440 raft_consensus.cc:3037] T cda8a639a1914915a2caaf8362fe2643 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.697235 25658 leader_election.cc:288] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.699111 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cda8a639a1914915a2caaf8362fe2643" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:28.699550 25483 leader_election.cc:341] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.700630 25440 raft_consensus.cc:2454] T cda8a639a1914915a2caaf8362fe2643 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:28.700978 25483 leader_election.cc:302] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.701222 25658 raft_consensus.cc:2781] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.701376 25658 raft_consensus.cc:686] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:28.701617 25658 consensus_queue.cc:237] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.703222 25641 consensus_queue.cc:1035] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.713232 25338 catalog_manager.cc:5484] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:28.717401 25710 consensus_queue.cc:1035] T 47b72129270d4be3bf173be990d530f3 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.717924 25338 catalog_manager.cc:5484] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.721244 25641 consensus_queue.cc:1035] T 1b44011e7fc24cb085f97afa28a0295f P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.722083 25339 catalog_manager.cc:5484] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.722934 25637 tablet_bootstrap.cc:492] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.723070 25637 ts_tablet_manager.cc:1367] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.243s user 0.073s sys 0.118s
I20240502 01:55:28.722776 25339 catalog_manager.cc:5484] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.723748 25635 tablet_bootstrap.cc:492] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.723878 25635 ts_tablet_manager.cc:1367] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.239s user 0.056s sys 0.098s
I20240502 01:55:28.724577 25635 raft_consensus.cc:348] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.724771 25635 raft_consensus.cc:374] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.724833 25635 raft_consensus.cc:729] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.725072 25635 consensus_queue.cc:260] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.725581 25635 ts_tablet_manager.cc:1398] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 01:55:28.725831 25635 tablet_bootstrap.cc:492] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.726550 25337 catalog_manager.cc:5484] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:28.727358 25637 raft_consensus.cc:348] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.727528 25637 raft_consensus.cc:374] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.727577 25637 raft_consensus.cc:729] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.727471 25337 catalog_manager.cc:5484] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3). New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } }
I20240502 01:55:28.727753 25637 consensus_queue.cc:260] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.728550 25635 tablet_bootstrap.cc:654] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.729030 25637 ts_tablet_manager.cc:1398] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:28.729277 25637 tablet_bootstrap.cc:492] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.729964 25792 consensus_queue.cc:1035] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.735694 25631 tablet_bootstrap.cc:492] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.735831 25631 ts_tablet_manager.cc:1367] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.127s user 0.020s sys 0.058s
I20240502 01:55:28.736481 25631 raft_consensus.cc:348] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.736593 25635 tablet_bootstrap.cc:492] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.736649 25631 raft_consensus.cc:374] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.736697 25631 raft_consensus.cc:729] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.736729 25635 ts_tablet_manager.cc:1367] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20240502 01:55:28.736969 25631 consensus_queue.cc:260] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.737080 25792 consensus_queue.cc:1035] T 8399bb471a684ee8880fdd9ad668fff3 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.737320 25635 raft_consensus.cc:348] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.737480 25635 raft_consensus.cc:374] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.737515 25631 ts_tablet_manager.cc:1398] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:28.737527 25635 raft_consensus.cc:729] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.737784 25631 tablet_bootstrap.cc:492] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.737784 25635 consensus_queue.cc:260] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.738548 25635 ts_tablet_manager.cc:1398] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:28.738935 25635 tablet_bootstrap.cc:492] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.741235 25631 tablet_bootstrap.cc:654] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.741654 25641 consensus_queue.cc:1035] T 62d013793fcb4f2a9fe28d149040f721 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.742918 25635 tablet_bootstrap.cc:654] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.743398 25637 tablet_bootstrap.cc:654] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.748839 25635 tablet_bootstrap.cc:492] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.748967 25635 ts_tablet_manager.cc:1367] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.001s
I20240502 01:55:28.749610 25635 raft_consensus.cc:348] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.749807 25635 raft_consensus.cc:374] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.749874 25635 raft_consensus.cc:729] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.750078 25635 consensus_queue.cc:260] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.750634 25635 ts_tablet_manager.cc:1398] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:28.750907 25635 tablet_bootstrap.cc:492] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.752391 25635 tablet_bootstrap.cc:654] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.755178 25631 tablet_bootstrap.cc:492] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.755306 25631 ts_tablet_manager.cc:1367] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.000s
I20240502 01:55:28.755942 25631 raft_consensus.cc:348] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.756121 25631 raft_consensus.cc:374] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.756176 25631 raft_consensus.cc:729] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.756347 25631 consensus_queue.cc:260] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.759805 25631 ts_tablet_manager.cc:1398] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:55:28.761008 25631 tablet_bootstrap.cc:492] T e04d952325064d5a9414dbefca50ce1c P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.762123 25635 tablet_bootstrap.cc:492] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.762317 25635 ts_tablet_manager.cc:1367] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20240502 01:55:28.762465 25631 tablet_bootstrap.cc:654] T e04d952325064d5a9414dbefca50ce1c P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.763025 25635 raft_consensus.cc:348] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.763193 25635 raft_consensus.cc:374] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.763270 25635 raft_consensus.cc:729] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.763489 25635 consensus_queue.cc:260] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.763600 25792 consensus_queue.cc:1035] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.763979 25635 ts_tablet_manager.cc:1398] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:28.764236 25635 tablet_bootstrap.cc:492] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.765748 25635 tablet_bootstrap.cc:654] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.768138 25792 consensus_queue.cc:1035] T 600040d630eb4fa9809d5d477c55dc41 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.769595 25635 tablet_bootstrap.cc:492] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.769713 25635 ts_tablet_manager.cc:1367] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 01:55:28.770640 25641 raft_consensus.cc:482] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.770749 25641 raft_consensus.cc:504] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.771386 25641 leader_election.cc:288] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.771896 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71689056867841e3aef8030fe4d2c58b" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.772527 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71689056867841e3aef8030fe4d2c58b" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.772717 25515 raft_consensus.cc:2454] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.773324 25406 leader_election.cc:302] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
W20240502 01:55:28.773725 25407 leader_election.cc:341] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.774006 25641 raft_consensus.cc:2781] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.774078 25641 raft_consensus.cc:482] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.774144 25641 raft_consensus.cc:3037] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.774295 25658 consensus_queue.cc:1035] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.777144 25641 raft_consensus.cc:504] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.778117 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71689056867841e3aef8030fe4d2c58b" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.778319 25515 raft_consensus.cc:3037] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.781149 25515 raft_consensus.cc:2454] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:28.781574 25406 leader_election.cc:302] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:28.781857 25641 leader_election.cc:288] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.781885 25804 raft_consensus.cc:2781] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.782027 25804 raft_consensus.cc:686] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:28.782217 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71689056867841e3aef8030fe4d2c58b" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:28.782315 25804 consensus_queue.cc:237] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
W20240502 01:55:28.782704 25407 leader_election.cc:341] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.786741 25658 raft_consensus.cc:482] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.770470 25635 raft_consensus.cc:348] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.786916 25658 raft_consensus.cc:504] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.787037 25635 raft_consensus.cc:374] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.787142 25635 raft_consensus.cc:729] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.787541 25658 leader_election.cc:288] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.787770 25635 consensus_queue.cc:260] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.788211 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c0d4918f3994489a7289728ca82deff" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.788409 25442 raft_consensus.cc:2454] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:28.788776 25635 ts_tablet_manager.cc:1398] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20240502 01:55:28.788828 25483 leader_election.cc:302] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:28.789064 25635 tablet_bootstrap.cc:492] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.789126 25658 raft_consensus.cc:2781] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.789234 25658 raft_consensus.cc:482] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.789345 25658 raft_consensus.cc:3037] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.790644 25635 tablet_bootstrap.cc:654] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.792286 25658 raft_consensus.cc:504] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.793306 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c0d4918f3994489a7289728ca82deff" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.793515 25442 raft_consensus.cc:3037] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.799376 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c0d4918f3994489a7289728ca82deff" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:28.799680 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c0d4918f3994489a7289728ca82deff" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:28.800153 25483 leader_election.cc:341] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.800386 25442 raft_consensus.cc:2454] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
W20240502 01:55:28.800834 25483 leader_election.cc:341] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.801225 25483 leader_election.cc:302] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.801441 25718 raft_consensus.cc:482] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.801618 25633 raft_consensus.cc:2781] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.801785 25658 leader_election.cc:288] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.802409 25718 raft_consensus.cc:504] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.803400 25718 leader_election.cc:288] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.803588 25633 raft_consensus.cc:686] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:28.803871 25633 consensus_queue.cc:237] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.805585 25641 raft_consensus.cc:482] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.806407 25641 raft_consensus.cc:504] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.807029 25641 leader_election.cc:288] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.807261 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9515b30bb98470f966aa70bdf23e721" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.807483 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1721db9e2cf341f98bad0f77824788ff" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.807685 25515 raft_consensus.cc:2454] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
W20240502 01:55:28.807760 25483 leader_election.cc:341] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.808072 25406 leader_election.cc:302] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:28.808384 25641 raft_consensus.cc:2781] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.808483 25641 raft_consensus.cc:482] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.810757 25718 consensus_queue.cc:1035] T 45cdd96cf1414bf794042b2d514aa82a P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.817561 25709 raft_consensus.cc:482] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.817713 25709 raft_consensus.cc:504] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.805780 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9515b30bb98470f966aa70bdf23e721" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.832253 25631 tablet_bootstrap.cc:492] T e04d952325064d5a9414dbefca50ce1c P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.832438 25631 ts_tablet_manager.cc:1367] T e04d952325064d5a9414dbefca50ce1c P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.071s user 0.017s sys 0.007s
I20240502 01:55:28.833357 25793 raft_consensus.cc:482] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.833477 25793 raft_consensus.cc:504] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.834044 25793 leader_election.cc:288] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.834256 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "feaebca58bd448eb8769581e94dd493c" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.808590 25641 raft_consensus.cc:3037] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.835016 25631 raft_consensus.cc:348] T e04d952325064d5a9414dbefca50ce1c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.835240 25631 raft_consensus.cc:374] T e04d952325064d5a9414dbefca50ce1c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.835328 25631 raft_consensus.cc:729] T e04d952325064d5a9414dbefca50ce1c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.835628 25631 consensus_queue.cc:260] T e04d952325064d5a9414dbefca50ce1c P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.836236 25631 ts_tablet_manager.cc:1398] T e04d952325064d5a9414dbefca50ce1c P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240502 01:55:28.836598 25631 tablet_bootstrap.cc:492] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.836972 25641 raft_consensus.cc:504] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.837824 25641 leader_election.cc:288] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.838179 25631 tablet_bootstrap.cc:654] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.838383 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1721db9e2cf341f98bad0f77824788ff" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.838672 25517 raft_consensus.cc:3037] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.838500 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1721db9e2cf341f98bad0f77824788ff" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:28.839202 25407 leader_election.cc:341] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.838692 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1721db9e2cf341f98bad0f77824788ff" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:28.839818 25407 leader_election.cc:341] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.841413 25339 catalog_manager.cc:5484] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.842717 25517 raft_consensus.cc:2454] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:28.843127 25406 leader_election.cc:302] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
W20240502 01:55:28.847126 25483 leader_election.cc:341] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.847287 25483 leader_election.cc:302] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9; no voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.847558 25633 raft_consensus.cc:2726] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.847720 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "feaebca58bd448eb8769581e94dd493c" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.847986 25517 raft_consensus.cc:2379] T feaebca58bd448eb8769581e94dd493c P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 481341cc6302403dab5dcc402f42a81f in this term.
I20240502 01:55:28.848340 25556 leader_election.cc:302] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:28.848749 25793 raft_consensus.cc:3037] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.851442 25793 raft_consensus.cc:2726] T feaebca58bd448eb8769581e94dd493c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.851649 25641 raft_consensus.cc:2781] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.851814 25641 raft_consensus.cc:686] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:28.852177 25641 consensus_queue.cc:237] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.855660 25709 leader_election.cc:288] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.856779 25633 raft_consensus.cc:482] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.856979 25633 raft_consensus.cc:504] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.857223 25637 tablet_bootstrap.cc:492] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.857270 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75bf436d41da407e8ce821896b041627" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.857395 25637 ts_tablet_manager.cc:1367] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.128s user 0.051s sys 0.057s
I20240502 01:55:28.857618 25633 leader_election.cc:288] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.858014 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb34d5458b92443c92f78bc26f6b3804" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.858194 25440 raft_consensus.cc:2454] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:28.858160 25637 raft_consensus.cc:348] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.858378 25637 raft_consensus.cc:374] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.858455 25637 raft_consensus.cc:729] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.858675 25637 consensus_queue.cc:260] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.858817 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb34d5458b92443c92f78bc26f6b3804" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.859316 25637 ts_tablet_manager.cc:1398] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:28.859292 25483 leader_election.cc:302] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
W20240502 01:55:28.859638 25483 leader_election.cc:341] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.859751 25633 raft_consensus.cc:2781] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.859851 25633 raft_consensus.cc:482] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.859977 25633 raft_consensus.cc:3037] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
W20240502 01:55:28.861506 25407 leader_election.cc:341] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.862181 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75bf436d41da407e8ce821896b041627" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
W20240502 01:55:28.862637 25406 leader_election.cc:341] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.862730 25406 leader_election.cc:302] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.863119 25804 raft_consensus.cc:2726] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.863946 25633 raft_consensus.cc:504] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.864504 25633 leader_election.cc:288] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.865294 25635 tablet_bootstrap.cc:492] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.865389 25635 ts_tablet_manager.cc:1367] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.076s user 0.002s sys 0.014s
I20240502 01:55:28.865907 25635 raft_consensus.cc:348] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.866031 25635 raft_consensus.cc:374] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.866061 25635 raft_consensus.cc:729] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.865850 25339 catalog_manager.cc:5484] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.866199 25635 consensus_queue.cc:260] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.866598 25635 ts_tablet_manager.cc:1398] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:28.866393 25339 catalog_manager.cc:5484] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.866811 25635 tablet_bootstrap.cc:492] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.868156 25635 tablet_bootstrap.cc:654] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.868901 25631 tablet_bootstrap.cc:492] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.869015 25631 ts_tablet_manager.cc:1367] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.001s
I20240502 01:55:28.869664 25631 raft_consensus.cc:348] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.869843 25631 raft_consensus.cc:374] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.869923 25631 raft_consensus.cc:729] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.870092 25631 consensus_queue.cc:260] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.870585 25631 ts_tablet_manager.cc:1398] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 01:55:28.871011 25631 tablet_bootstrap.cc:492] T cb89dc94017c476aa8377bf49fd2d07b P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.872393 25631 tablet_bootstrap.cc:654] T cb89dc94017c476aa8377bf49fd2d07b P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.872756 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb34d5458b92443c92f78bc26f6b3804" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.872938 25440 raft_consensus.cc:3037] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.875458 25440 raft_consensus.cc:2454] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:28.878165 25637 tablet_bootstrap.cc:492] T e04d952325064d5a9414dbefca50ce1c P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.879678 25637 tablet_bootstrap.cc:654] T e04d952325064d5a9414dbefca50ce1c P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.879951 25631 tablet_bootstrap.cc:492] T cb89dc94017c476aa8377bf49fd2d07b P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.880086 25631 ts_tablet_manager.cc:1367] T cb89dc94017c476aa8377bf49fd2d07b P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.002s
I20240502 01:55:28.880693 25631 raft_consensus.cc:348] T cb89dc94017c476aa8377bf49fd2d07b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.880859 25631 raft_consensus.cc:374] T cb89dc94017c476aa8377bf49fd2d07b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.880908 25631 raft_consensus.cc:729] T cb89dc94017c476aa8377bf49fd2d07b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.880877 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb34d5458b92443c92f78bc26f6b3804" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:28.881127 25635 tablet_bootstrap.cc:492] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.881103 25631 consensus_queue.cc:260] T cb89dc94017c476aa8377bf49fd2d07b P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.881230 25635 ts_tablet_manager.cc:1367] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.010s
I20240502 01:55:28.881561 25631 ts_tablet_manager.cc:1398] T cb89dc94017c476aa8377bf49fd2d07b P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 01:55:28.881810 25635 raft_consensus.cc:348] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.881973 25631 tablet_bootstrap.cc:492] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.881983 25635 raft_consensus.cc:374] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.882057 25635 raft_consensus.cc:729] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.882290 25635 consensus_queue.cc:260] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.882735 25635 ts_tablet_manager.cc:1398] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 01:55:28.883019 25635 tablet_bootstrap.cc:492] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.884485 25635 tablet_bootstrap.cc:654] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.884485 25631 tablet_bootstrap.cc:654] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
W20240502 01:55:28.882040 25483 leader_election.cc:341] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.886005 25483 leader_election.cc:302] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.886073 25637 tablet_bootstrap.cc:492] T e04d952325064d5a9414dbefca50ce1c P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.886269 25770 raft_consensus.cc:2781] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.886286 25637 ts_tablet_manager.cc:1367] T e04d952325064d5a9414dbefca50ce1c P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20240502 01:55:28.886410 25770 raft_consensus.cc:686] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:28.886670 25770 consensus_queue.cc:237] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.887778 25631 tablet_bootstrap.cc:492] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.887912 25631 ts_tablet_manager.cc:1367] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20240502 01:55:28.888459 25631 raft_consensus.cc:348] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.888640 25631 raft_consensus.cc:374] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.888684 25631 raft_consensus.cc:729] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.888813 25631 consensus_queue.cc:260] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.889232 25631 ts_tablet_manager.cc:1398] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:28.889462 25631 tablet_bootstrap.cc:492] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.888459 25637 raft_consensus.cc:348] T e04d952325064d5a9414dbefca50ce1c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.890653 25637 raft_consensus.cc:374] T e04d952325064d5a9414dbefca50ce1c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.890733 25637 raft_consensus.cc:729] T e04d952325064d5a9414dbefca50ce1c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.890929 25637 consensus_queue.cc:260] T e04d952325064d5a9414dbefca50ce1c P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.891386 25637 ts_tablet_manager.cc:1398] T e04d952325064d5a9414dbefca50ce1c P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:55:28.890542 25631 tablet_bootstrap.cc:654] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.891415 25337 catalog_manager.cc:5484] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.892441 25635 tablet_bootstrap.cc:492] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.892572 25635 ts_tablet_manager.cc:1367] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.003s
I20240502 01:55:28.893163 25635 raft_consensus.cc:348] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.893318 25635 raft_consensus.cc:374] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.893368 25635 raft_consensus.cc:729] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.893533 25635 consensus_queue.cc:260] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.893982 25635 ts_tablet_manager.cc:1398] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:28.894201 25635 tablet_bootstrap.cc:492] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.895962 25635 tablet_bootstrap.cc:654] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.896935 25637 tablet_bootstrap.cc:492] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.898428 25637 tablet_bootstrap.cc:654] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.900866 25631 tablet_bootstrap.cc:492] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.900977 25631 ts_tablet_manager.cc:1367] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.009s
I20240502 01:55:28.901137 25635 tablet_bootstrap.cc:492] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.901266 25635 ts_tablet_manager.cc:1367] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20240502 01:55:28.901502 25631 raft_consensus.cc:348] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.901628 25631 raft_consensus.cc:374] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.901675 25631 raft_consensus.cc:729] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.901849 25631 consensus_queue.cc:260] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.902249 25631 ts_tablet_manager.cc:1398] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:28.901854 25635 raft_consensus.cc:348] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.902560 25631 tablet_bootstrap.cc:492] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.902571 25635 raft_consensus.cc:374] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.902794 25635 raft_consensus.cc:729] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.903013 25635 consensus_queue.cc:260] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.903502 25635 ts_tablet_manager.cc:1398] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:28.903762 25635 tablet_bootstrap.cc:492] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.903959 25631 tablet_bootstrap.cc:654] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.904807 25637 tablet_bootstrap.cc:492] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.904980 25637 ts_tablet_manager.cc:1367] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.004s
I20240502 01:55:28.905174 25635 tablet_bootstrap.cc:654] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.905715 25637 raft_consensus.cc:348] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.905936 25637 raft_consensus.cc:374] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.906041 25637 raft_consensus.cc:729] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.906250 25637 consensus_queue.cc:260] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.906600 25804 consensus_queue.cc:1035] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.906891 25637 ts_tablet_manager.cc:1398] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:28.907195 25637 tablet_bootstrap.cc:492] T 15cacbe419b1480f9ea528e3a31c32f3 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.908857 25637 tablet_bootstrap.cc:654] T 15cacbe419b1480f9ea528e3a31c32f3 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.914434 25640 consensus_queue.cc:1035] T 4fab7be12223417a873e8747bb4ce8fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.919624 25637 tablet_bootstrap.cc:492] T 15cacbe419b1480f9ea528e3a31c32f3 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.919786 25637 ts_tablet_manager.cc:1367] T 15cacbe419b1480f9ea528e3a31c32f3 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.002s
I20240502 01:55:28.920432 25637 raft_consensus.cc:348] T 15cacbe419b1480f9ea528e3a31c32f3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.920643 25637 raft_consensus.cc:374] T 15cacbe419b1480f9ea528e3a31c32f3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.920747 25637 raft_consensus.cc:729] T 15cacbe419b1480f9ea528e3a31c32f3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.920985 25637 consensus_queue.cc:260] T 15cacbe419b1480f9ea528e3a31c32f3 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.921535 25637 ts_tablet_manager.cc:1398] T 15cacbe419b1480f9ea528e3a31c32f3 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:28.921824 25637 tablet_bootstrap.cc:492] T cb89dc94017c476aa8377bf49fd2d07b P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.923319 25637 tablet_bootstrap.cc:654] T cb89dc94017c476aa8377bf49fd2d07b P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.928380 25770 raft_consensus.cc:482] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.928519 25770 raft_consensus.cc:504] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.929137 25770 leader_election.cc:288] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.929644 25640 raft_consensus.cc:482] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.929646 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adfecdabe3c04439bddacefd7be19242" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.929849 25440 raft_consensus.cc:2454] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:28.929793 25640 raft_consensus.cc:504] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.930217 25483 leader_election.cc:302] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:28.930315 25640 leader_election.cc:288] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.930470 25770 raft_consensus.cc:2781] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.930550 25770 raft_consensus.cc:482] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.930622 25770 raft_consensus.cc:3037] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.930727 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adfecdabe3c04439bddacefd7be19242" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:28.931217 25483 leader_election.cc:341] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.931725 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e04d952325064d5a9414dbefca50ce1c" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.931933 25517 raft_consensus.cc:2454] T e04d952325064d5a9414dbefca50ce1c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.932300 25406 leader_election.cc:302] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:28.932538 25640 raft_consensus.cc:2781] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.932611 25640 raft_consensus.cc:482] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.932675 25640 raft_consensus.cc:3037] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.933486 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e04d952325064d5a9414dbefca50ce1c" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.933673 25589 raft_consensus.cc:2454] T e04d952325064d5a9414dbefca50ce1c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.935110 25710 consensus_queue.cc:1035] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.935348 25640 raft_consensus.cc:504] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.935086 25718 consensus_queue.cc:1035] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.936213 25640 leader_election.cc:288] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.936477 25637 tablet_bootstrap.cc:492] T cb89dc94017c476aa8377bf49fd2d07b P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.936633 25637 ts_tablet_manager.cc:1367] T cb89dc94017c476aa8377bf49fd2d07b P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.010s
I20240502 01:55:28.936681 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e04d952325064d5a9414dbefca50ce1c" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:28.936851 25589 raft_consensus.cc:3037] T e04d952325064d5a9414dbefca50ce1c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.937399 25637 raft_consensus.cc:348] T cb89dc94017c476aa8377bf49fd2d07b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.937527 25637 raft_consensus.cc:374] T cb89dc94017c476aa8377bf49fd2d07b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.937575 25637 raft_consensus.cc:729] T cb89dc94017c476aa8377bf49fd2d07b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.937745 25637 consensus_queue.cc:260] T cb89dc94017c476aa8377bf49fd2d07b P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.938189 25637 ts_tablet_manager.cc:1398] T cb89dc94017c476aa8377bf49fd2d07b P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:28.938935 25637 tablet_bootstrap.cc:492] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.939652 25589 raft_consensus.cc:2454] T e04d952325064d5a9414dbefca50ce1c P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:28.940361 25637 tablet_bootstrap.cc:654] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.940418 25407 leader_election.cc:302] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.940640 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e04d952325064d5a9414dbefca50ce1c" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.940810 25515 raft_consensus.cc:3037] T e04d952325064d5a9414dbefca50ce1c P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.942768 25710 raft_consensus.cc:2781] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.942915 25710 raft_consensus.cc:686] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:28.943173 25710 consensus_queue.cc:237] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.943555 25635 tablet_bootstrap.cc:492] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.943675 25635 ts_tablet_manager.cc:1367] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.040s user 0.018s sys 0.002s
I20240502 01:55:28.944681 25770 raft_consensus.cc:504] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.943686 25515 raft_consensus.cc:2454] T e04d952325064d5a9414dbefca50ce1c P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:28.945444 25635 raft_consensus.cc:348] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.945609 25635 raft_consensus.cc:374] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.945659 25635 raft_consensus.cc:729] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.945693 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adfecdabe3c04439bddacefd7be19242" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.945848 25770 leader_election.cc:288] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.945869 25437 raft_consensus.cc:3037] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.946041 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adfecdabe3c04439bddacefd7be19242" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:28.946427 25483 leader_election.cc:341] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.946997 25635 consensus_queue.cc:260] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.947665 25635 ts_tablet_manager.cc:1398] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240502 01:55:28.948568 25437 raft_consensus.cc:2454] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:28.950099 25483 leader_election.cc:302] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.950412 25631 tablet_bootstrap.cc:492] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.951401 25631 ts_tablet_manager.cc:1367] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.049s user 0.013s sys 0.006s
I20240502 01:55:28.951643 25770 raft_consensus.cc:2781] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.951826 25770 raft_consensus.cc:686] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:28.952044 25770 consensus_queue.cc:237] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.952353 25640 raft_consensus.cc:482] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.952461 25640 raft_consensus.cc:504] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.953002 25640 leader_election.cc:288] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.953466 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325a9997b7724b7a999511469e0cf9da" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.953778 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325a9997b7724b7a999511469e0cf9da" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
W20240502 01:55:28.953828 25407 leader_election.cc:341] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
W20240502 01:55:28.954254 25406 leader_election.cc:341] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.954370 25406 leader_election.cc:302] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.954726 25640 raft_consensus.cc:2726] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.952025 25631 raft_consensus.cc:348] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.955471 25631 raft_consensus.cc:374] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.955528 25631 raft_consensus.cc:729] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.955718 25631 consensus_queue.cc:260] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.957115 25631 ts_tablet_manager.cc:1398] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240502 01:55:28.948604 25635 tablet_bootstrap.cc:492] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.957360 25631 tablet_bootstrap.cc:492] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:28.959043 25635 tablet_bootstrap.cc:654] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.962323 25637 tablet_bootstrap.cc:492] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.962443 25637 ts_tablet_manager.cc:1367] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.013s
I20240502 01:55:28.963119 25637 raft_consensus.cc:348] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.963299 25637 raft_consensus.cc:374] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.963353 25637 raft_consensus.cc:729] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.963532 25637 consensus_queue.cc:260] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.964424 25637 ts_tablet_manager.cc:1398] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:28.964922 25631 tablet_bootstrap.cc:654] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.965224 25637 tablet_bootstrap.cc:492] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.966169 25710 consensus_queue.cc:1035] T feaebca58bd448eb8769581e94dd493c P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.967090 25637 tablet_bootstrap.cc:654] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.967825 25718 raft_consensus.cc:482] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.967967 25718 raft_consensus.cc:504] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.968472 25718 leader_election.cc:288] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.969137 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ddecb61ec374e229ae91cda1bfbd6c5" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:28.969811 25483 leader_election.cc:341] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.971433 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ddecb61ec374e229ae91cda1bfbd6c5" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.971608 25437 raft_consensus.cc:2454] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:28.971964 25483 leader_election.cc:302] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.972302 25718 raft_consensus.cc:2781] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.972376 25718 raft_consensus.cc:482] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.972442 25718 raft_consensus.cc:3037] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.974869 25637 tablet_bootstrap.cc:492] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:28.974972 25710 raft_consensus.cc:482] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.975092 25710 raft_consensus.cc:504] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.975452 25718 raft_consensus.cc:504] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.975631 25710 leader_election.cc:288] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.976020 25718 leader_election.cc:288] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.976167 25718 consensus_queue.cc:1035] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.976334 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8824314ff50341f4ac45b9d16bc2e338" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.976609 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ddecb61ec374e229ae91cda1bfbd6c5" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:28.976729 25407 leader_election.cc:341] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.976935 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8824314ff50341f4ac45b9d16bc2e338" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
W20240502 01:55:28.977370 25483 leader_election.cc:341] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
W20240502 01:55:28.977568 25406 leader_election.cc:341] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:28.977598 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ddecb61ec374e229ae91cda1bfbd6c5" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:28.977674 25406 leader_election.cc:302] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.977744 25437 raft_consensus.cc:3037] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.978010 25710 raft_consensus.cc:2726] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:28.980468 25437 raft_consensus.cc:2454] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:28.980829 25483 leader_election.cc:302] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:28.981148 25718 raft_consensus.cc:2781] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:28.981328 25637 ts_tablet_manager.cc:1367] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.000s
I20240502 01:55:28.981336 25718 raft_consensus.cc:686] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:28.981608 25718 consensus_queue.cc:237] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.982010 25637 raft_consensus.cc:348] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.982197 25637 raft_consensus.cc:374] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.982249 25637 raft_consensus.cc:729] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.982474 25637 consensus_queue.cc:260] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.983062 25637 ts_tablet_manager.cc:1398] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:28.983320 25637 tablet_bootstrap.cc:492] T cda8a639a1914915a2caaf8362fe2643 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:28.984849 25637 tablet_bootstrap.cc:654] T cda8a639a1914915a2caaf8362fe2643 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.987085 25339 catalog_manager.cc:5484] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:28.987767 25635 tablet_bootstrap.cc:492] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:28.987957 25635 ts_tablet_manager.cc:1367] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.039s user 0.007s sys 0.020s
I20240502 01:55:28.988626 25635 raft_consensus.cc:348] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.988858 25635 raft_consensus.cc:374] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:28.988965 25635 raft_consensus.cc:729] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:28.989228 25635 consensus_queue.cc:260] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.989775 25635 ts_tablet_manager.cc:1398] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:28.990087 25635 tablet_bootstrap.cc:492] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:28.991612 25635 tablet_bootstrap.cc:654] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:28.991621 25687 raft_consensus.cc:482] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.991781 25687 raft_consensus.cc:504] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.992269 25710 raft_consensus.cc:482] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:28.992376 25687 leader_election.cc:288] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:28.992866 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71689056867841e3aef8030fe4d2c58b" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.992395 25710 raft_consensus.cc:504] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.993357 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71689056867841e3aef8030fe4d2c58b" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:28.993499 25710 leader_election.cc:288] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:28.993934 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cacbe419b1480f9ea528e3a31c32f3" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:28.994099 25591 raft_consensus.cc:2454] T 15cacbe419b1480f9ea528e3a31c32f3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.994668 25407 leader_election.cc:302] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:28.994839 25687 consensus_queue.cc:1035] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:28.993062 25517 raft_consensus.cc:2379] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 481341cc6302403dab5dcc402f42a81f in this term.
I20240502 01:55:28.995206 25710 raft_consensus.cc:2781] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:28.995303 25710 raft_consensus.cc:482] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:28.995384 25710 raft_consensus.cc:3037] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.995412 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cacbe419b1480f9ea528e3a31c32f3" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:28.995605 25515 raft_consensus.cc:2454] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:28.996017 25556 leader_election.cc:302] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:28.997640 25631 tablet_bootstrap.cc:492] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:28.997670 25687 raft_consensus.cc:3037] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.997845 25710 raft_consensus.cc:504] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:28.998631 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cacbe419b1480f9ea528e3a31c32f3" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:28.998780 25517 raft_consensus.cc:3037] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:28.998917 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cacbe419b1480f9ea528e3a31c32f3" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:28.999069 25591 raft_consensus.cc:3037] T 15cacbe419b1480f9ea528e3a31c32f3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.000245 25687 raft_consensus.cc:2726] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:29.000581 25631 ts_tablet_manager.cc:1367] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.003s
I20240502 01:55:29.001142 25517 raft_consensus.cc:2454] T 15cacbe419b1480f9ea528e3a31c32f3 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:29.001199 25631 raft_consensus.cc:348] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.001502 25591 raft_consensus.cc:2454] T 15cacbe419b1480f9ea528e3a31c32f3 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:29.001518 25406 leader_election.cc:302] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.002182 25640 raft_consensus.cc:2781] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.002298 25640 raft_consensus.cc:686] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:29.002477 25633 raft_consensus.cc:482] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.002583 25633 raft_consensus.cc:504] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.002563 25640 consensus_queue.cc:237] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.003145 25710 leader_election.cc:288] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.001499 25631 raft_consensus.cc:374] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.003855 25631 raft_consensus.cc:729] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.004020 25631 consensus_queue.cc:260] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.004542 25631 ts_tablet_manager.cc:1398] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20240502 01:55:29.004787 25631 tablet_bootstrap.cc:492] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:29.005755 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dcf64b234454dbe8cb1ff3c2e3639d7" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:29.006295 25635 tablet_bootstrap.cc:492] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:29.006518 25635 ts_tablet_manager.cc:1367] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.004s
I20240502 01:55:29.006520 25631 tablet_bootstrap.cc:654] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.007387 25635 raft_consensus.cc:348] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.007644 25635 raft_consensus.cc:374] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.007611 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dcf64b234454dbe8cb1ff3c2e3639d7" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.007746 25635 raft_consensus.cc:729] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.007817 25440 raft_consensus.cc:2454] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:29.003162 25633 leader_election.cc:288] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.008594 25483 leader_election.cc:302] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
W20240502 01:55:29.008826 25483 leader_election.cc:341] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.009085 25633 raft_consensus.cc:2781] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.009155 25633 raft_consensus.cc:482] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.009212 25633 raft_consensus.cc:3037] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.008085 25635 consensus_queue.cc:260] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.010594 25635 ts_tablet_manager.cc:1398] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20240502 01:55:29.010932 25635 tablet_bootstrap.cc:492] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:29.011876 25633 raft_consensus.cc:504] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.012506 25635 tablet_bootstrap.cc:654] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.012970 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dcf64b234454dbe8cb1ff3c2e3639d7" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:29.013130 25440 raft_consensus.cc:3037] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.013525 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dcf64b234454dbe8cb1ff3c2e3639d7" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:29.014814 25792 consensus_queue.cc:1035] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.015812 25440 raft_consensus.cc:2454] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.015875 25633 leader_election.cc:288] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
W20240502 01:55:29.016212 25483 leader_election.cc:341] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.016563 25483 leader_election.cc:302] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:29.016770 25633 raft_consensus.cc:2781] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.016968 25633 raft_consensus.cc:686] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:29.017206 25633 consensus_queue.cc:237] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.019021 25631 tablet_bootstrap.cc:492] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:29.019145 25631 ts_tablet_manager.cc:1367] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.001s
I20240502 01:55:29.020772 25631 raft_consensus.cc:348] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.020970 25631 raft_consensus.cc:374] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.021028 25631 raft_consensus.cc:729] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.021888 25631 consensus_queue.cc:260] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.022428 25631 ts_tablet_manager.cc:1398] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240502 01:55:29.022684 25631 tablet_bootstrap.cc:492] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:29.022935 25635 tablet_bootstrap.cc:492] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:29.023106 25635 ts_tablet_manager.cc:1367] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20240502 01:55:29.023967 25635 raft_consensus.cc:348] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.024214 25635 raft_consensus.cc:374] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.024307 25635 raft_consensus.cc:729] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.024581 25635 consensus_queue.cc:260] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.025159 25635 ts_tablet_manager.cc:1398] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:29.025468 25635 tablet_bootstrap.cc:492] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:29.024142 25631 tablet_bootstrap.cc:654] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.027205 25635 tablet_bootstrap.cc:654] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.029912 25792 raft_consensus.cc:482] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.030035 25792 raft_consensus.cc:504] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.030611 25792 leader_election.cc:288] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:29.030895 25631 tablet_bootstrap.cc:492] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:29.031014 25631 ts_tablet_manager.cc:1367] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20240502 01:55:29.031198 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb34d5458b92443c92f78bc26f6b3804" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.031409 25437 raft_consensus.cc:2379] T fb34d5458b92443c92f78bc26f6b3804 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 77c36b03bf7c42a9a430cc595953aff9 in this term.
I20240502 01:55:29.032239 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb34d5458b92443c92f78bc26f6b3804" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.032755 25556 leader_election.cc:302] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:29.033200 25792 raft_consensus.cc:3037] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.033237 25631 raft_consensus.cc:348] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.033495 25631 raft_consensus.cc:374] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.033582 25631 raft_consensus.cc:729] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.033871 25631 consensus_queue.cc:260] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.036095 25792 raft_consensus.cc:2726] T fb34d5458b92443c92f78bc26f6b3804 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:29.036101 25631 ts_tablet_manager.cc:1398] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:55:29.036537 25631 tablet_bootstrap.cc:492] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:29.037514 25792 raft_consensus.cc:482] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.037636 25792 raft_consensus.cc:504] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.037956 25339 catalog_manager.cc:5484] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.038439 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c0d4918f3994489a7289728ca82deff" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.038633 25437 raft_consensus.cc:2379] T 1c0d4918f3994489a7289728ca82deff P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 77c36b03bf7c42a9a430cc595953aff9 in this term.
I20240502 01:55:29.039463 25792 leader_election.cc:288] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:29.039582 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c0d4918f3994489a7289728ca82deff" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.040060 25556 leader_election.cc:302] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:29.040241 25631 tablet_bootstrap.cc:654] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.040488 25792 raft_consensus.cc:3037] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.043076 25792 raft_consensus.cc:2726] T 1c0d4918f3994489a7289728ca82deff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:29.045207 25338 catalog_manager.cc:5484] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.045956 25635 tablet_bootstrap.cc:492] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:29.046126 25635 ts_tablet_manager.cc:1367] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.006s
I20240502 01:55:29.046902 25635 raft_consensus.cc:348] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.047144 25635 raft_consensus.cc:374] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.047238 25635 raft_consensus.cc:729] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.047519 25635 consensus_queue.cc:260] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.048072 25635 ts_tablet_manager.cc:1398] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:29.048390 25635 tablet_bootstrap.cc:492] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:29.049902 25635 tablet_bootstrap.cc:654] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.050134 25710 raft_consensus.cc:482] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.050261 25710 raft_consensus.cc:504] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.050788 25710 leader_election.cc:288] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.051110 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb89dc94017c476aa8377bf49fd2d07b" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.051291 25515 raft_consensus.cc:2454] T cb89dc94017c476aa8377bf49fd2d07b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:29.051265 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb89dc94017c476aa8377bf49fd2d07b" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:29.051463 25589 raft_consensus.cc:2454] T cb89dc94017c476aa8377bf49fd2d07b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:29.051796 25407 leader_election.cc:302] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:29.052031 25710 raft_consensus.cc:2781] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.052093 25710 raft_consensus.cc:482] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.052160 25710 raft_consensus.cc:3037] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.054527 25710 raft_consensus.cc:504] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.055402 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb89dc94017c476aa8377bf49fd2d07b" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:29.055562 25515 raft_consensus.cc:3037] T cb89dc94017c476aa8377bf49fd2d07b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.057843 25631 tablet_bootstrap.cc:492] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:29.058017 25631 ts_tablet_manager.cc:1367] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.006s
I20240502 01:55:29.058807 25631 raft_consensus.cc:348] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.059090 25631 raft_consensus.cc:374] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.059187 25631 raft_consensus.cc:729] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.058130 25635 tablet_bootstrap.cc:492] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:29.059166 25792 consensus_queue.cc:1035] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.059607 25635 ts_tablet_manager.cc:1367] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.003s
I20240502 01:55:29.060310 25635 raft_consensus.cc:348] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.060564 25635 raft_consensus.cc:374] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.060657 25635 raft_consensus.cc:729] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.060891 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb89dc94017c476aa8377bf49fd2d07b" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:29.061090 25589 raft_consensus.cc:3037] T cb89dc94017c476aa8377bf49fd2d07b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.061244 25635 consensus_queue.cc:260] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.061642 25339 catalog_manager.cc:5484] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.062119 25339 catalog_manager.cc:5484] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.063565 25589 raft_consensus.cc:2454] T cb89dc94017c476aa8377bf49fd2d07b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:29.060839 25631 consensus_queue.cc:260] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.064143 25407 leader_election.cc:302] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:29.064414 25709 raft_consensus.cc:2781] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.064532 25709 raft_consensus.cc:686] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:29.064735 25709 consensus_queue.cc:237] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.065266 25631 ts_tablet_manager.cc:1398] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20240502 01:55:29.065874 25631 tablet_bootstrap.cc:492] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:29.066128 25637 tablet_bootstrap.cc:492] T cda8a639a1914915a2caaf8362fe2643 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.065594 25635 ts_tablet_manager.cc:1398] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20240502 01:55:29.066279 25637 ts_tablet_manager.cc:1367] T cda8a639a1914915a2caaf8362fe2643 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.083s user 0.030s sys 0.028s
I20240502 01:55:29.066545 25635 tablet_bootstrap.cc:492] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:29.066954 25637 raft_consensus.cc:348] T cda8a639a1914915a2caaf8362fe2643 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.067153 25637 raft_consensus.cc:374] T cda8a639a1914915a2caaf8362fe2643 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.067271 25637 raft_consensus.cc:729] T cda8a639a1914915a2caaf8362fe2643 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.067518 25637 consensus_queue.cc:260] T cda8a639a1914915a2caaf8362fe2643 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.068086 25635 tablet_bootstrap.cc:654] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.068128 25637 ts_tablet_manager.cc:1398] T cda8a639a1914915a2caaf8362fe2643 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:55:29.068536 25637 tablet_bootstrap.cc:492] T 35d2910628774d18af9b616272b05260 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.058020 25515 raft_consensus.cc:2454] T cb89dc94017c476aa8377bf49fd2d07b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:29.070096 25637 tablet_bootstrap.cc:654] T 35d2910628774d18af9b616272b05260 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.070103 25631 tablet_bootstrap.cc:654] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.072721 25710 leader_election.cc:288] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.078176 25635 tablet_bootstrap.cc:492] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:29.078398 25635 ts_tablet_manager.cc:1367] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20240502 01:55:29.078122 25792 consensus_queue.cc:1035] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.079293 25635 raft_consensus.cc:348] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.079581 25635 raft_consensus.cc:374] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.079713 25635 raft_consensus.cc:729] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.080080 25635 consensus_queue.cc:260] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.080758 25635 ts_tablet_manager.cc:1398] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:29.081097 25635 tablet_bootstrap.cc:492] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f: Bootstrap starting.
I20240502 01:55:29.082616 25635 tablet_bootstrap.cc:654] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.084987 25792 consensus_queue.cc:1035] T c6adb7e9b9fa4b858ce0f42b8416cc3c P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.088533 25710 raft_consensus.cc:482] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.088706 25710 raft_consensus.cc:504] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.089565 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fcf0c1ff88f41c681a940a3db368e1a" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
W20240502 01:55:29.090031 25406 leader_election.cc:341] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.090616 25710 leader_election.cc:288] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.090884 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fcf0c1ff88f41c681a940a3db368e1a" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:29.091367 25407 leader_election.cc:341] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.091495 25407 leader_election.cc:302] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f; no voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:29.091902 25710 raft_consensus.cc:2726] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:29.094267 25680 consensus_queue.cc:1035] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.102329 25680 consensus_queue.cc:1035] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20240502 01:55:29.110850 25589 raft_consensus.cc:3037] T cda8a639a1914915a2caaf8362fe2643 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.114485 25658 consensus_queue.cc:1035] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.125487 25633 raft_consensus.cc:482] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.125662 25633 raft_consensus.cc:504] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.126343 25633 leader_election.cc:288] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.127193 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e139c33535c94f1aa2b444fef24038a0" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.127432 25442 raft_consensus.cc:2454] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:29.127797 25483 leader_election.cc:302] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.128087 25633 raft_consensus.cc:2781] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.128207 25633 raft_consensus.cc:482] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.128309 25633 raft_consensus.cc:3037] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.131028 25633 raft_consensus.cc:504] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.131937 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e139c33535c94f1aa2b444fef24038a0" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:29.132131 25442 raft_consensus.cc:3037] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.135504 25633 leader_election.cc:288] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.135695 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e139c33535c94f1aa2b444fef24038a0" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:29.136195 25483 leader_election.cc:341] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.136353 25442 raft_consensus.cc:2454] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.136695 25483 leader_election.cc:302] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:29.137944 25633 raft_consensus.cc:2781] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.138093 25633 raft_consensus.cc:686] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:29.138398 25633 consensus_queue.cc:237] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.139530 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e139c33535c94f1aa2b444fef24038a0" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:29.139986 25483 leader_election.cc:341] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.141884 25637 tablet_bootstrap.cc:492] T 35d2910628774d18af9b616272b05260 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.142084 25637 ts_tablet_manager.cc:1367] T 35d2910628774d18af9b616272b05260 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.074s user 0.020s sys 0.046s
I20240502 01:55:29.143472 25658 raft_consensus.cc:482] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.143644 25658 raft_consensus.cc:504] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.144243 25658 leader_election.cc:288] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.146152 25637 raft_consensus.cc:348] T 35d2910628774d18af9b616272b05260 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.146368 25637 raft_consensus.cc:374] T 35d2910628774d18af9b616272b05260 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.146298 25787 consensus_queue.cc:1035] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.146477 25637 raft_consensus.cc:729] T 35d2910628774d18af9b616272b05260 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.146756 25637 consensus_queue.cc:260] T 35d2910628774d18af9b616272b05260 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.147547 25637 ts_tablet_manager.cc:1398] T 35d2910628774d18af9b616272b05260 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:55:29.147897 25637 tablet_bootstrap.cc:492] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.146956 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee8b791ab244610b38e826d805bea27" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.148176 25442 raft_consensus.cc:2454] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:29.149171 25590 raft_consensus.cc:3037] T 35d2910628774d18af9b616272b05260 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.149667 25637 tablet_bootstrap.cc:654] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.150264 25483 leader_election.cc:302] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.150434 25770 consensus_queue.cc:1035] T cda8a639a1914915a2caaf8362fe2643 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.151819 25770 raft_consensus.cc:2781] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.151928 25770 raft_consensus.cc:482] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.152060 25770 raft_consensus.cc:3037] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.153097 25641 consensus_queue.cc:1035] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.154493 25770 raft_consensus.cc:504] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.156978 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee8b791ab244610b38e826d805bea27" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:29.157716 25483 leader_election.cc:341] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.157371 25770 leader_election.cc:288] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.157920 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee8b791ab244610b38e826d805bea27" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:29.157941 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee8b791ab244610b38e826d805bea27" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:29.158356 25440 raft_consensus.cc:3037] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
W20240502 01:55:29.158573 25483 leader_election.cc:341] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.167615 25440 raft_consensus.cc:2454] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.168180 25483 leader_election.cc:302] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:29.168550 25770 raft_consensus.cc:2781] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.168656 25770 raft_consensus.cc:686] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:29.168884 25770 consensus_queue.cc:237] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.175475 25339 catalog_manager.cc:5484] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.182906 25718 raft_consensus.cc:482] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.183121 25718 raft_consensus.cc:504] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.184854 25640 consensus_queue.cc:1035] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.185601 25437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c091595af786411ab065cb62430c1f9b" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.185799 25437 raft_consensus.cc:2454] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:29.186129 25483 leader_election.cc:302] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.186376 25658 raft_consensus.cc:2781] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.186448 25658 raft_consensus.cc:482] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.186515 25658 raft_consensus.cc:3037] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.189282 25658 raft_consensus.cc:504] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.189857 25658 leader_election.cc:288] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.190362 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c091595af786411ab065cb62430c1f9b" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:29.190688 25440 raft_consensus.cc:3037] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.192518 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c091595af786411ab065cb62430c1f9b" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:29.192976 25483 leader_election.cc:341] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.194805 25718 leader_election.cc:288] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.195047 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c091595af786411ab065cb62430c1f9b" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:29.195446 25483 leader_election.cc:341] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.197197 25635 tablet_bootstrap.cc:492] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f: No bootstrap required, opened a new log
I20240502 01:55:29.197419 25635 ts_tablet_manager.cc:1367] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f: Time spent bootstrapping tablet: real 0.116s user 0.030s sys 0.024s
I20240502 01:55:29.198311 25635 raft_consensus.cc:348] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.199437 25635 raft_consensus.cc:374] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.199628 25635 raft_consensus.cc:729] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.199923 25635 consensus_queue.cc:260] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.200850 25440 raft_consensus.cc:2454] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.201212 25483 leader_election.cc:302] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:29.200904 25635 ts_tablet_manager.cc:1398] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:55:29.201614 25718 raft_consensus.cc:2781] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.201803 25718 raft_consensus.cc:686] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:29.202056 25718 consensus_queue.cc:237] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.206529 25658 raft_consensus.cc:482] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.206643 25658 raft_consensus.cc:504] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.207229 25658 leader_election.cc:288] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.207265 25709 consensus_queue.cc:1035] T 35d2910628774d18af9b616272b05260 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.208463 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8824314ff50341f4ac45b9d16bc2e338" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:29.209275 25483 leader_election.cc:341] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.208995 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8824314ff50341f4ac45b9d16bc2e338" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.210289 25442 raft_consensus.cc:2454] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:29.210602 25483 leader_election.cc:302] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:29.210983 25658 raft_consensus.cc:2781] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.211053 25658 raft_consensus.cc:482] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.211112 25658 raft_consensus.cc:3037] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.213760 25658 raft_consensus.cc:504] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.214323 25658 leader_election.cc:288] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.215090 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8824314ff50341f4ac45b9d16bc2e338" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:29.215502 25483 leader_election.cc:341] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.218201 25637 tablet_bootstrap.cc:492] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.218338 25637 ts_tablet_manager.cc:1367] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.071s user 0.041s sys 0.028s
I20240502 01:55:29.219110 25637 raft_consensus.cc:348] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.219283 25637 raft_consensus.cc:374] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.219326 25637 raft_consensus.cc:729] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.219528 25637 consensus_queue.cc:260] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.220111 25637 ts_tablet_manager.cc:1398] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:29.220371 25637 tablet_bootstrap.cc:492] T a9515b30bb98470f966aa70bdf23e721 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.222020 25637 tablet_bootstrap.cc:654] T a9515b30bb98470f966aa70bdf23e721 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.222780 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8824314ff50341f4ac45b9d16bc2e338" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:29.222947 25440 raft_consensus.cc:3037] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.226647 25440 raft_consensus.cc:2454] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.227013 25483 leader_election.cc:302] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:29.228157 25339 catalog_manager.cc:5484] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.229718 25637 tablet_bootstrap.cc:492] T a9515b30bb98470f966aa70bdf23e721 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.229831 25637 ts_tablet_manager.cc:1367] T a9515b30bb98470f966aa70bdf23e721 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20240502 01:55:29.230049 25710 raft_consensus.cc:482] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.230163 25710 raft_consensus.cc:504] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.230460 25718 raft_consensus.cc:2781] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.230566 25718 raft_consensus.cc:686] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:29.230482 25637 raft_consensus.cc:348] T a9515b30bb98470f966aa70bdf23e721 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.230679 25637 raft_consensus.cc:374] T a9515b30bb98470f966aa70bdf23e721 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.230711 25710 leader_election.cc:288] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.230736 25637 raft_consensus.cc:729] T a9515b30bb98470f966aa70bdf23e721 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.230929 25637 consensus_queue.cc:260] T a9515b30bb98470f966aa70bdf23e721 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.230984 25718 consensus_queue.cc:237] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.231468 25637 ts_tablet_manager.cc:1398] T a9515b30bb98470f966aa70bdf23e721 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:55:29.231707 25637 tablet_bootstrap.cc:492] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.231894 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a57f0b51324d02b9ce36a71d5dbd90" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.232044 25517 raft_consensus.cc:2454] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:29.232400 25406 leader_election.cc:302] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.232635 25710 raft_consensus.cc:2781] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.232697 25710 raft_consensus.cc:482] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.232749 25710 raft_consensus.cc:3037] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.233096 25637 tablet_bootstrap.cc:654] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.235248 25710 raft_consensus.cc:504] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.236469 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a57f0b51324d02b9ce36a71d5dbd90" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:29.236649 25517 raft_consensus.cc:3037] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.238575 25637 tablet_bootstrap.cc:492] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.238688 25637 ts_tablet_manager.cc:1367] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20240502 01:55:29.239049 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a57f0b51324d02b9ce36a71d5dbd90" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:29.239216 25517 raft_consensus.cc:2454] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:29.239351 25637 raft_consensus.cc:348] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.239517 25637 raft_consensus.cc:374] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.239581 25637 raft_consensus.cc:729] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
W20240502 01:55:29.239596 25407 leader_election.cc:341] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.239779 25637 consensus_queue.cc:260] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.239889 25406 leader_election.cc:302] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.240258 25710 leader_election.cc:288] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.240577 25710 raft_consensus.cc:2781] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.240679 25710 raft_consensus.cc:686] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:29.240878 25710 consensus_queue.cc:237] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.241376 25637 ts_tablet_manager.cc:1398] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240502 01:55:29.241626 25637 tablet_bootstrap.cc:492] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.241968 25804 consensus_queue.cc:1035] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.243091 25637 tablet_bootstrap.cc:654] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.241391 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a57f0b51324d02b9ce36a71d5dbd90" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:29.243542 25407 leader_election.cc:341] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.246528 25637 tablet_bootstrap.cc:492] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.246647 25637 ts_tablet_manager.cc:1367] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20240502 01:55:29.247344 25637 raft_consensus.cc:348] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.247515 25637 raft_consensus.cc:374] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.247565 25637 raft_consensus.cc:729] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.247756 25637 consensus_queue.cc:260] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.247808 25337 catalog_manager.cc:5484] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.247570 25339 catalog_manager.cc:5484] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.248121 25770 raft_consensus.cc:482] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.248293 25637 ts_tablet_manager.cc:1398] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:55:29.248314 25770 raft_consensus.cc:504] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.248539 25637 tablet_bootstrap.cc:492] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.249440 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cb657546744202be12c0972b25f8fd" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.249608 25440 raft_consensus.cc:2454] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:29.249945 25483 leader_election.cc:302] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.250038 25637 tablet_bootstrap.cc:654] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.250201 25633 raft_consensus.cc:2781] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.250272 25633 raft_consensus.cc:482] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.248355 25339 catalog_manager.cc:5484] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.250334 25633 raft_consensus.cc:3037] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.250564 25339 catalog_manager.cc:5484] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.252830 25633 raft_consensus.cc:504] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.253393 25633 leader_election.cc:288] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.254312 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cb657546744202be12c0972b25f8fd" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:29.254473 25440 raft_consensus.cc:3037] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.256966 25440 raft_consensus.cc:2454] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.257565 25483 leader_election.cc:302] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.257969 25658 raft_consensus.cc:2781] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.258004 25631 tablet_bootstrap.cc:492] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:29.258069 25658 raft_consensus.cc:686] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:29.258123 25631 ts_tablet_manager.cc:1367] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.192s user 0.043s sys 0.030s
I20240502 01:55:29.258214 25658 consensus_queue.cc:237] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.258425 25680 raft_consensus.cc:482] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.258523 25680 raft_consensus.cc:504] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.258785 25631 raft_consensus.cc:348] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.258980 25631 raft_consensus.cc:374] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.259032 25631 raft_consensus.cc:729] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.259081 25680 leader_election.cc:288] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:29.259656 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c091595af786411ab065cb62430c1f9b" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.259858 25440 raft_consensus.cc:2379] T c091595af786411ab065cb62430c1f9b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 77c36b03bf7c42a9a430cc595953aff9 in this term.
I20240502 01:55:29.260027 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cb657546744202be12c0972b25f8fd" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:29.260457 25483 leader_election.cc:341] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.260690 25710 raft_consensus.cc:482] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.260825 25710 raft_consensus.cc:504] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.260984 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c091595af786411ab065cb62430c1f9b" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.261441 25556 leader_election.cc:302] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:29.261649 25710 leader_election.cc:288] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.261682 25788 raft_consensus.cc:3037] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.261829 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9515b30bb98470f966aa70bdf23e721" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.261979 25512 raft_consensus.cc:2454] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:29.262367 25406 leader_election.cc:302] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.262720 25710 raft_consensus.cc:2781] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.262786 25710 raft_consensus.cc:482] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.262862 25710 raft_consensus.cc:3037] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.263633 25631 consensus_queue.cc:260] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.264189 25788 raft_consensus.cc:2726] T c091595af786411ab065cb62430c1f9b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:29.264549 25631 ts_tablet_manager.cc:1398] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240502 01:55:29.264592 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9515b30bb98470f966aa70bdf23e721" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:29.264807 25631 tablet_bootstrap.cc:492] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:29.264839 25590 raft_consensus.cc:2454] T a9515b30bb98470f966aa70bdf23e721 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:29.265312 25710 raft_consensus.cc:504] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.266149 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9515b30bb98470f966aa70bdf23e721" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:29.266314 25512 raft_consensus.cc:3037] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.268195 25512 raft_consensus.cc:2454] T a9515b30bb98470f966aa70bdf23e721 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:29.269022 25406 leader_election.cc:302] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.266214 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9515b30bb98470f966aa70bdf23e721" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:29.269341 25590 raft_consensus.cc:3037] T a9515b30bb98470f966aa70bdf23e721 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.269346 25640 raft_consensus.cc:2781] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.269738 25640 raft_consensus.cc:686] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:29.269960 25640 consensus_queue.cc:237] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.272290 25590 raft_consensus.cc:2454] T a9515b30bb98470f966aa70bdf23e721 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:29.273679 25658 consensus_queue.cc:1035] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.273929 25339 catalog_manager.cc:5484] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.275084 25591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cb657546744202be12c0972b25f8fd" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:29.275588 25631 tablet_bootstrap.cc:654] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
W20240502 01:55:29.275557 25483 leader_election.cc:341] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.279922 25770 leader_election.cc:288] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.261982 25718 consensus_queue.cc:1035] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20240502 01:55:29.280529 25710 leader_election.cc:288] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.285434 25631 tablet_bootstrap.cc:492] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:29.285559 25631 ts_tablet_manager.cc:1367] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20240502 01:55:29.286202 25631 raft_consensus.cc:348] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.286391 25631 raft_consensus.cc:374] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.286443 25631 raft_consensus.cc:729] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.286654 25631 consensus_queue.cc:260] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.287149 25633 consensus_queue.cc:1035] T fb34d5458b92443c92f78bc26f6b3804 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.286681 25338 catalog_manager.cc:5484] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.288889 25631 ts_tablet_manager.cc:1398] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:55:29.289150 25631 tablet_bootstrap.cc:492] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9: Bootstrap starting.
I20240502 01:55:29.291290 25637 tablet_bootstrap.cc:492] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.291409 25637 ts_tablet_manager.cc:1367] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.043s user 0.015s sys 0.025s
I20240502 01:55:29.291738 25631 tablet_bootstrap.cc:654] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.292037 25637 raft_consensus.cc:348] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.292207 25637 raft_consensus.cc:374] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.292269 25637 raft_consensus.cc:729] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.292474 25637 consensus_queue.cc:260] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.293063 25637 ts_tablet_manager.cc:1398] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:55:29.293324 25637 tablet_bootstrap.cc:492] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.296054 25637 tablet_bootstrap.cc:654] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.298990 25718 raft_consensus.cc:482] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.299115 25718 raft_consensus.cc:504] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.299953 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2b4ef78604481aa1908c93daa714f5" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.300136 25442 raft_consensus.cc:2454] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:29.300516 25483 leader_election.cc:302] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.301086 25770 raft_consensus.cc:2781] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.301177 25770 raft_consensus.cc:482] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.301252 25770 raft_consensus.cc:3037] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.303876 25718 leader_election.cc:288] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.304232 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2b4ef78604481aa1908c93daa714f5" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:29.304602 25483 leader_election.cc:341] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.304746 25770 raft_consensus.cc:504] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.305287 25770 leader_election.cc:288] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.306555 25633 consensus_queue.cc:1035] T 1c0d4918f3994489a7289728ca82deff P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.309940 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2b4ef78604481aa1908c93daa714f5" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:29.309916 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2b4ef78604481aa1908c93daa714f5" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:29.310168 25440 raft_consensus.cc:3037] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
W20240502 01:55:29.310317 25483 leader_election.cc:341] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.312072 25440 raft_consensus.cc:2454] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.312426 25483 leader_election.cc:302] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:29.312690 25770 raft_consensus.cc:2781] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.312835 25770 raft_consensus.cc:686] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:29.313079 25770 consensus_queue.cc:237] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.313321 25631 tablet_bootstrap.cc:492] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9: No bootstrap required, opened a new log
I20240502 01:55:29.313524 25631 ts_tablet_manager.cc:1367] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.002s
I20240502 01:55:29.314288 25631 raft_consensus.cc:348] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.314528 25631 raft_consensus.cc:374] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.314602 25631 raft_consensus.cc:729] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.316620 25631 consensus_queue.cc:260] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.317525 25631 ts_tablet_manager.cc:1398] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:55:29.319847 25637 tablet_bootstrap.cc:492] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.320029 25637 ts_tablet_manager.cc:1367] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.018s
I20240502 01:55:29.320699 25637 raft_consensus.cc:348] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.320928 25637 raft_consensus.cc:374] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.321033 25637 raft_consensus.cc:729] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.321282 25637 consensus_queue.cc:260] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.321452 25338 catalog_manager.cc:5484] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.321825 25637 ts_tablet_manager.cc:1398] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:29.322182 25637 tablet_bootstrap.cc:492] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.323984 25637 tablet_bootstrap.cc:654] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.327380 25637 tablet_bootstrap.cc:492] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.327525 25637 ts_tablet_manager.cc:1367] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 01:55:29.328236 25637 raft_consensus.cc:348] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.328433 25637 raft_consensus.cc:374] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.328531 25637 raft_consensus.cc:729] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.328739 25637 consensus_queue.cc:260] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.329224 25637 ts_tablet_manager.cc:1398] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 01:55:29.329504 25637 tablet_bootstrap.cc:492] T 75bf436d41da407e8ce821896b041627 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.329826 25680 raft_consensus.cc:482] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.329977 25680 raft_consensus.cc:504] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.330406 25787 raft_consensus.cc:482] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.330590 25680 leader_election.cc:288] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:29.330562 25787 raft_consensus.cc:504] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.331018 25637 tablet_bootstrap.cc:654] T 75bf436d41da407e8ce821896b041627 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.331146 25787 leader_election.cc:288] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:29.331400 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adfecdabe3c04439bddacefd7be19242" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.331616 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee8b791ab244610b38e826d805bea27" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.331686 25442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adfecdabe3c04439bddacefd7be19242" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.331924 25442 raft_consensus.cc:2379] T adfecdabe3c04439bddacefd7be19242 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 77c36b03bf7c42a9a430cc595953aff9 in this term.
I20240502 01:55:29.332221 25440 raft_consensus.cc:2379] T 4ee8b791ab244610b38e826d805bea27 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 77c36b03bf7c42a9a430cc595953aff9 in this term.
I20240502 01:55:29.332796 25557 leader_election.cc:302] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:29.333135 25517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ee8b791ab244610b38e826d805bea27" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.333999 25556 leader_election.cc:302] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:29.334076 25710 consensus_queue.cc:1035] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.334416 25788 raft_consensus.cc:3037] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.335716 25637 tablet_bootstrap.cc:492] T 75bf436d41da407e8ce821896b041627 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.335858 25637 ts_tablet_manager.cc:1367] T 75bf436d41da407e8ce821896b041627 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.003s
I20240502 01:55:29.336347 25637 raft_consensus.cc:348] T 75bf436d41da407e8ce821896b041627 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.336498 25637 raft_consensus.cc:374] T 75bf436d41da407e8ce821896b041627 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.336565 25637 raft_consensus.cc:729] T 75bf436d41da407e8ce821896b041627 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.336560 25788 raft_consensus.cc:2726] T adfecdabe3c04439bddacefd7be19242 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:29.336822 25637 consensus_queue.cc:260] T 75bf436d41da407e8ce821896b041627 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.336905 25792 raft_consensus.cc:3037] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.338713 25637 ts_tablet_manager.cc:1398] T 75bf436d41da407e8ce821896b041627 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:55:29.339056 25637 tablet_bootstrap.cc:492] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.339748 25710 consensus_queue.cc:1035] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.340194 25792 raft_consensus.cc:2726] T 4ee8b791ab244610b38e826d805bea27 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:29.340334 25637 tablet_bootstrap.cc:654] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.342375 25637 tablet_bootstrap.cc:492] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.342527 25637 ts_tablet_manager.cc:1367] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:55:29.343266 25637 raft_consensus.cc:348] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.343468 25637 raft_consensus.cc:374] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.343577 25637 raft_consensus.cc:729] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.343837 25637 consensus_queue.cc:260] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.344431 25637 ts_tablet_manager.cc:1398] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:29.344749 25637 tablet_bootstrap.cc:492] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.346216 25637 tablet_bootstrap.cc:654] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.348387 25770 raft_consensus.cc:482] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.348556 25770 raft_consensus.cc:504] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.348893 25641 consensus_queue.cc:1035] T e04d952325064d5a9414dbefca50ce1c P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.349152 25770 leader_election.cc:288] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.349579 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325a9997b7724b7a999511469e0cf9da" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.349828 25440 raft_consensus.cc:2454] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:29.350255 25483 leader_election.cc:302] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.350561 25770 raft_consensus.cc:2781] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.350661 25770 raft_consensus.cc:482] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.350773 25770 raft_consensus.cc:3037] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.351965 25637 tablet_bootstrap.cc:492] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.352092 25637 ts_tablet_manager.cc:1367] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20240502 01:55:29.352699 25637 raft_consensus.cc:348] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.352898 25637 raft_consensus.cc:374] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.352962 25637 raft_consensus.cc:729] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.353119 25637 consensus_queue.cc:260] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.353543 25770 raft_consensus.cc:504] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.353698 25637 ts_tablet_manager.cc:1398] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 01:55:29.354010 25637 tablet_bootstrap.cc:492] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.354171 25770 leader_election.cc:288] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.354637 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325a9997b7724b7a999511469e0cf9da" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:29.354614 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325a9997b7724b7a999511469e0cf9da" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:29.354867 25589 raft_consensus.cc:3037] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.354897 25440 raft_consensus.cc:3037] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.350379 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325a9997b7724b7a999511469e0cf9da" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:29.357417 25440 raft_consensus.cc:2454] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.357419 25589 raft_consensus.cc:2454] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.357933 25483 leader_election.cc:302] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.358296 25718 raft_consensus.cc:2781] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.358506 25718 raft_consensus.cc:686] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:29.358790 25718 consensus_queue.cc:237] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.359300 25637 tablet_bootstrap.cc:654] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.359614 25770 consensus_queue.cc:1035] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.366559 25640 raft_consensus.cc:482] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.366703 25640 raft_consensus.cc:504] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.366799 25590 raft_consensus.cc:3037] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.367316 25640 leader_election.cc:288] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.367866 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de09870b6fba4a19bf37028fea65f5bd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
W20240502 01:55:29.368407 25407 leader_election.cc:341] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.369161 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de09870b6fba4a19bf37028fea65f5bd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.369433 25515 raft_consensus.cc:2454] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 0.
I20240502 01:55:29.369818 25406 leader_election.cc:302] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:29.369910 25640 consensus_queue.cc:1035] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.370239 25710 raft_consensus.cc:2781] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.370332 25710 raft_consensus.cc:482] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.370445 25710 raft_consensus.cc:3037] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.373024 25710 raft_consensus.cc:504] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.374061 25589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de09870b6fba4a19bf37028fea65f5bd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
W20240502 01:55:29.374526 25407 leader_election.cc:341] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:55:29.374718 25710 leader_election.cc:288] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.376632 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de09870b6fba4a19bf37028fea65f5bd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:29.376878 25515 raft_consensus.cc:3037] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.380102 25515 raft_consensus.cc:2454] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 1.
I20240502 01:55:29.380829 25406 leader_election.cc:302] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters: a7ffa3e1ba614911a5fc9fafc38573f1
I20240502 01:55:29.381539 25640 raft_consensus.cc:2781] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.381681 25640 raft_consensus.cc:686] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:29.383225 25640 consensus_queue.cc:237] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.389359 25338 catalog_manager.cc:5484] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.391973 25637 tablet_bootstrap.cc:492] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.392127 25637 ts_tablet_manager.cc:1367] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.038s user 0.010s sys 0.018s
I20240502 01:55:29.392876 25637 raft_consensus.cc:348] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.393083 25637 raft_consensus.cc:374] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.393188 25637 raft_consensus.cc:729] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.393400 25637 consensus_queue.cc:260] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.393980 25637 ts_tablet_manager.cc:1398] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:55:29.394269 25637 tablet_bootstrap.cc:492] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.395242 25338 catalog_manager.cc:5484] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 0 to 1, leader changed from <none> to 481341cc6302403dab5dcc402f42a81f (127.23.192.1). New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.395808 25637 tablet_bootstrap.cc:654] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.397543 25637 tablet_bootstrap.cc:492] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.397715 25637 ts_tablet_manager.cc:1367] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240502 01:55:29.398342 25637 raft_consensus.cc:348] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.398562 25637 raft_consensus.cc:374] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.398648 25637 raft_consensus.cc:729] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.398774 25658 consensus_queue.cc:1035] T adfecdabe3c04439bddacefd7be19242 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.398906 25637 consensus_queue.cc:260] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.399447 25637 ts_tablet_manager.cc:1398] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:29.399722 25637 tablet_bootstrap.cc:492] T 4fcf0c1ff88f41c681a940a3db368e1a P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.400025 25792 raft_consensus.cc:482] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.400152 25792 raft_consensus.cc:504] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.400758 25792 leader_election.cc:288] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:29.401625 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cb657546744202be12c0972b25f8fd" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.401870 25440 raft_consensus.cc:2379] T 15cb657546744202be12c0972b25f8fd P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 77c36b03bf7c42a9a430cc595953aff9 in this term.
I20240502 01:55:29.402556 25640 consensus_queue.cc:1035] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.403550 25637 tablet_bootstrap.cc:654] T 4fcf0c1ff88f41c681a940a3db368e1a P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.404711 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15cb657546744202be12c0972b25f8fd" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.405354 25556 leader_election.cc:302] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:29.405896 25787 raft_consensus.cc:3037] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.408687 25787 raft_consensus.cc:2726] T 15cb657546744202be12c0972b25f8fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:29.409607 25658 raft_consensus.cc:482] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.409757 25658 raft_consensus.cc:504] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.410359 25658 leader_election.cc:288] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.411338 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75bf436d41da407e8ce821896b041627" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.411535 25440 raft_consensus.cc:2454] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:29.411492 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75bf436d41da407e8ce821896b041627" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:29.411720 25586 raft_consensus.cc:2454] T 75bf436d41da407e8ce821896b041627 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:29.411914 25483 leader_election.cc:302] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.412354 25658 raft_consensus.cc:2781] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.412506 25658 raft_consensus.cc:482] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.412534 25637 tablet_bootstrap.cc:492] T 4fcf0c1ff88f41c681a940a3db368e1a P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.412623 25658 raft_consensus.cc:3037] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.412690 25637 ts_tablet_manager.cc:1367] T 4fcf0c1ff88f41c681a940a3db368e1a P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.002s
I20240502 01:55:29.413278 25637 raft_consensus.cc:348] T 4fcf0c1ff88f41c681a940a3db368e1a P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.413448 25637 raft_consensus.cc:374] T 4fcf0c1ff88f41c681a940a3db368e1a P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.413554 25637 raft_consensus.cc:729] T 4fcf0c1ff88f41c681a940a3db368e1a P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.413754 25637 consensus_queue.cc:260] T 4fcf0c1ff88f41c681a940a3db368e1a P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.414166 25637 ts_tablet_manager.cc:1398] T 4fcf0c1ff88f41c681a940a3db368e1a P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:29.414426 25637 tablet_bootstrap.cc:492] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.414572 25787 raft_consensus.cc:482] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.414703 25787 raft_consensus.cc:504] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.415232 25658 raft_consensus.cc:504] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.415657 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e139c33535c94f1aa2b444fef24038a0" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.415695 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e139c33535c94f1aa2b444fef24038a0" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.415658 25787 leader_election.cc:288] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:29.415925 25637 tablet_bootstrap.cc:654] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.415938 25440 raft_consensus.cc:2379] T e139c33535c94f1aa2b444fef24038a0 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 77c36b03bf7c42a9a430cc595953aff9 in this term.
I20240502 01:55:29.416420 25557 leader_election.cc:302] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:29.416680 25792 raft_consensus.cc:3037] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.416898 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75bf436d41da407e8ce821896b041627" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:29.417073 25440 raft_consensus.cc:3037] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.419124 25792 raft_consensus.cc:2726] T e139c33535c94f1aa2b444fef24038a0 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:29.416551 25658 leader_election.cc:288] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.419550 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75bf436d41da407e8ce821896b041627" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:29.419849 25586 raft_consensus.cc:3037] T 75bf436d41da407e8ce821896b041627 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.421801 25586 raft_consensus.cc:2454] T 75bf436d41da407e8ce821896b041627 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.422335 25483 leader_election.cc:302] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77c36b03bf7c42a9a430cc595953aff9, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:29.422485 25440 raft_consensus.cc:2454] T 75bf436d41da407e8ce821896b041627 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.422917 25770 raft_consensus.cc:2781] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.423035 25770 raft_consensus.cc:686] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:29.423306 25770 consensus_queue.cc:237] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.426609 25336 catalog_manager.cc:5484] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.428577 25637 tablet_bootstrap.cc:492] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.428740 25637 ts_tablet_manager.cc:1367] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.006s
I20240502 01:55:29.429416 25637 raft_consensus.cc:348] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.429615 25637 raft_consensus.cc:374] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.429683 25637 raft_consensus.cc:729] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.429912 25637 consensus_queue.cc:260] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.430598 25637 ts_tablet_manager.cc:1398] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 01:55:29.430954 25637 tablet_bootstrap.cc:492] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1: Bootstrap starting.
I20240502 01:55:29.432404 25637 tablet_bootstrap.cc:654] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:55:29.432476 25804 consensus_queue.cc:1035] T 15cacbe419b1480f9ea528e3a31c32f3 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.432827 25590 raft_consensus.cc:3037] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.436264 25770 consensus_queue.cc:1035] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.446008 25770 consensus_queue.cc:1035] T 6dcf64b234454dbe8cb1ff3c2e3639d7 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.449563 25637 tablet_bootstrap.cc:492] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1: No bootstrap required, opened a new log
I20240502 01:55:29.449688 25637 ts_tablet_manager.cc:1367] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.007s
I20240502 01:55:29.450318 25637 raft_consensus.cc:348] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.450507 25637 raft_consensus.cc:374] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:55:29.450620 25637 raft_consensus.cc:729] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ffa3e1ba614911a5fc9fafc38573f1, State: Initialized, Role: FOLLOWER
I20240502 01:55:29.450937 25637 consensus_queue.cc:260] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.451562 25637 ts_tablet_manager.cc:1398] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:29.457604 25792 raft_consensus.cc:482] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.457751 25792 raft_consensus.cc:504] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.458258 25792 leader_election.cc:288] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:29.458633 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de09870b6fba4a19bf37028fea65f5bd" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.458637 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de09870b6fba4a19bf37028fea65f5bd" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.458920 25512 raft_consensus.cc:2379] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 481341cc6302403dab5dcc402f42a81f in this term.
I20240502 01:55:29.459333 25556 leader_election.cc:302] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:29.459573 25792 raft_consensus.cc:3037] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.461242 25792 raft_consensus.cc:2726] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20240502 01:55:29.469329 25387 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240502 01:55:29.483979 25787 raft_consensus.cc:482] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.484167 25787 raft_consensus.cc:504] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.484760 25787 leader_election.cc:288] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:29.485098 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a57f0b51324d02b9ce36a71d5dbd90" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.485240 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5a57f0b51324d02b9ce36a71d5dbd90" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.485599 25512 raft_consensus.cc:2379] T b5a57f0b51324d02b9ce36a71d5dbd90 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 481341cc6302403dab5dcc402f42a81f in this term.
I20240502 01:55:29.486075 25556 leader_election.cc:302] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:29.486347 25792 raft_consensus.cc:3037] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.488695 25792 raft_consensus.cc:2726] T b5a57f0b51324d02b9ce36a71d5dbd90 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:29.500790 25804 raft_consensus.cc:482] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.500936 25804 raft_consensus.cc:504] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.501528 25804 leader_election.cc:288] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.501770 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.501972 25512 raft_consensus.cc:2454] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 2.
I20240502 01:55:29.502099 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:29.502326 25586 raft_consensus.cc:2454] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 2.
I20240502 01:55:29.502630 25407 leader_election.cc:302] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:29.502866 25804 raft_consensus.cc:2781] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20240502 01:55:29.502944 25804 raft_consensus.cc:482] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.503003 25804 raft_consensus.cc:3037] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:29.505334 25804 raft_consensus.cc:504] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.505908 25804 leader_election.cc:288] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 3 election: Requested vote from peers 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.506278 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:29.506410 25586 raft_consensus.cc:3037] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:29.508765 25586 raft_consensus.cc:2454] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 3.
I20240502 01:55:29.509121 25407 leader_election.cc:302] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, a7ffa3e1ba614911a5fc9fafc38573f1; no voters:
I20240502 01:55:29.509353 25804 raft_consensus.cc:2781] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 3 FOLLOWER]: Leader election won for term 3
I20240502 01:55:29.509475 25804 raft_consensus.cc:686] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 3 LEADER]: Becoming Leader. State: Replica: 481341cc6302403dab5dcc402f42a81f, State: Running, Role: LEADER
I20240502 01:55:29.509688 25804 consensus_queue.cc:237] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.512735 25339 catalog_manager.cc:5484] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.516734 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b64e37777a0493aa438b49a92d9f4fd" candidate_uuid: "481341cc6302403dab5dcc402f42a81f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9"
I20240502 01:55:29.516894 25512 raft_consensus.cc:3037] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 2 FOLLOWER]: Advancing to term 3
I20240502 01:55:29.518945 25512 raft_consensus.cc:2454] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481341cc6302403dab5dcc402f42a81f in term 3.
I20240502 01:55:29.533383 25804 consensus_queue.cc:1035] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.536700 25640 consensus_queue.cc:1035] T cb89dc94017c476aa8377bf49fd2d07b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.542016 25658 consensus_queue.cc:1035] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.545114 25718 consensus_queue.cc:1035] T e139c33535c94f1aa2b444fef24038a0 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.551141 25586 raft_consensus.cc:3037] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.553378 25718 consensus_queue.cc:1035] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.556437 25718 consensus_queue.cc:1035] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.606303 25718 raft_consensus.cc:482] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.606474 25718 raft_consensus.cc:504] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.607100 25718 leader_election.cc:288] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.607457 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fcf0c1ff88f41c681a940a3db368e1a" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.607510 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fcf0c1ff88f41c681a940a3db368e1a" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" is_pre_election: true
I20240502 01:55:29.607637 25440 raft_consensus.cc:2454] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:29.607667 25586 raft_consensus.cc:2454] T 4fcf0c1ff88f41c681a940a3db368e1a P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 0.
I20240502 01:55:29.607990 25483 leader_election.cc:302] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.608186 25718 raft_consensus.cc:2781] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:55:29.608255 25718 raft_consensus.cc:482] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:55:29.608312 25718 raft_consensus.cc:3037] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.610198 25718 raft_consensus.cc:504] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.610647 25718 leader_election.cc:288] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Requested vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:29.611037 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fcf0c1ff88f41c681a940a3db368e1a" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f"
I20240502 01:55:29.611054 25586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fcf0c1ff88f41c681a940a3db368e1a" candidate_uuid: "77c36b03bf7c42a9a430cc595953aff9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1"
I20240502 01:55:29.611212 25440 raft_consensus.cc:3037] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.611219 25586 raft_consensus.cc:3037] T 4fcf0c1ff88f41c681a940a3db368e1a P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.613755 25586 raft_consensus.cc:2454] T 4fcf0c1ff88f41c681a940a3db368e1a P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.613755 25440 raft_consensus.cc:2454] T 4fcf0c1ff88f41c681a940a3db368e1a P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77c36b03bf7c42a9a430cc595953aff9 in term 1.
I20240502 01:55:29.614117 25483 leader_election.cc:302] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9; no voters:
I20240502 01:55:29.614327 25718 raft_consensus.cc:2781] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:55:29.614449 25718 raft_consensus.cc:686] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Becoming Leader. State: Replica: 77c36b03bf7c42a9a430cc595953aff9, State: Running, Role: LEADER
I20240502 01:55:29.614703 25718 consensus_queue.cc:237] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.617367 25336 catalog_manager.cc:5484] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2). New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:29.630055 25718 consensus_queue.cc:1035] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.634071 25658 consensus_queue.cc:1035] T 4ee8b791ab244610b38e826d805bea27 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.636576 25658 consensus_queue.cc:1035] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.640108 25586 raft_consensus.cc:3037] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.642217 25788 raft_consensus.cc:482] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:55:29.642338 25788 raft_consensus.cc:504] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } }
I20240502 01:55:29.642920 25788 leader_election.cc:288] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851), 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:29.643374 25440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2b4ef78604481aa1908c93daa714f5" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481341cc6302403dab5dcc402f42a81f" is_pre_election: true
I20240502 01:55:29.643509 25512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf2b4ef78604481aa1908c93daa714f5" candidate_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77c36b03bf7c42a9a430cc595953aff9" is_pre_election: true
I20240502 01:55:29.643586 25440 raft_consensus.cc:2379] T cf2b4ef78604481aa1908c93daa714f5 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ffa3e1ba614911a5fc9fafc38573f1 in current term 1: Already voted for candidate 77c36b03bf7c42a9a430cc595953aff9 in this term.
I20240502 01:55:29.643990 25557 leader_election.cc:302] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ffa3e1ba614911a5fc9fafc38573f1; no voters: 481341cc6302403dab5dcc402f42a81f, 77c36b03bf7c42a9a430cc595953aff9
I20240502 01:55:29.644232 25788 raft_consensus.cc:3037] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:55:29.643668 25718 consensus_queue.cc:1035] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.646449 25788 raft_consensus.cc:2726] T cf2b4ef78604481aa1908c93daa714f5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:55:29.646960 25658 consensus_queue.cc:1035] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.651201 25658 consensus_queue.cc:1035] T 15cb657546744202be12c0972b25f8fd P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.760643 25658 consensus_queue.cc:1035] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.764025 25658 consensus_queue.cc:1035] T c091595af786411ab065cb62430c1f9b P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.772560 25640 consensus_queue.cc:1035] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.776568 25640 consensus_queue.cc:1035] T a9515b30bb98470f966aa70bdf23e721 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.788852 25640 consensus_queue.cc:1035] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.789796 25718 consensus_queue.cc:1035] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.793753 25641 consensus_queue.cc:1035] T b5a57f0b51324d02b9ce36a71d5dbd90 P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.795426 25770 consensus_queue.cc:1035] T cf2b4ef78604481aa1908c93daa714f5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.857009 25633 consensus_queue.cc:1035] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.860167 25633 consensus_queue.cc:1035] T 75bf436d41da407e8ce821896b041627 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.875109 25633 consensus_queue.cc:1035] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.878154 25658 consensus_queue.cc:1035] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.889084 25640 consensus_queue.cc:1035] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.892832 25804 consensus_queue.cc:1035] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.955750 25517 raft_consensus.cc:1261] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 3 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20240502 01:55:29.956166 25710 consensus_queue.cc:1035] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:29.959156 25586 raft_consensus.cc:1261] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 3 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20240502 01:55:29.959718 25640 consensus_queue.cc:1035] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:30.034055 24320 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:55:30.036413 26029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:55:30.036701 26030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:55:30.055716 26032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:55:30.056027 24320 server_base.cc:1034] running on GCE node
I20240502 01:55:30.056234 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 01:55:30.056285 24320 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 01:55:30.056315 24320 hybrid_clock.cc:648] HybridClock initialized: now 1714614930056311 us; error 0 us; skew 500 ppm
I20240502 01:55:30.056473 24320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 01:55:30.058040 24320 webserver.cc:460] Webserver started at http://127.23.192.4:41723/ using document root <none> and password file <none>
I20240502 01:55:30.058254 24320 fs_manager.cc:359] Metadata directory not provided
I20240502 01:55:30.058312 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:55:30.058449 24320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:55:30.059105 24320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-3-root/instance:
uuid: "e6f4ddf520ea4341adafe59ace70e6dc"
format_stamp: "Formatted at 2024-05-02 01:55:30 on dist-test-slave-kdrn"
I20240502 01:55:30.061615 24320 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:30.063263 26037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:30.063620 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240502 01:55:30.063724 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-3-root
uuid: "e6f4ddf520ea4341adafe59ace70e6dc"
format_stamp: "Formatted at 2024-05-02 01:55:30 on dist-test-slave-kdrn"
I20240502 01:55:30.063835 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:55:30.082466 24320 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:55:30.082868 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:55:30.083302 24320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:55:30.084092 24320 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:55:30.084143 24320 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:30.084213 24320 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:55:30.084252 24320 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:55:30.098079 24320 rpc_server.cc:307] RPC server started. Bound to: 127.23.192.4:45835
I20240502 01:55:30.098094 26099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.23.192.4:45835 every 8 connection(s)
I20240502 01:55:30.099042 24320 auto_leader_rebalancer-test.cc:405] add a tserver: e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:30.107160 26100 heartbeater.cc:347] Connected to a master server at 127.23.192.62:43317
I20240502 01:55:30.107275 26100 heartbeater.cc:464] Registering TS with master...
I20240502 01:55:30.107587 26100 heartbeater.cc:511] Master 127.23.192.62:43317 requested a full tablet report, sending...
I20240502 01:55:30.108256 25336 ts_manager.cc:194] Registered new tserver with Master: e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835)
I20240502 01:55:30.109109 25336 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53738
I20240502 01:55:30.159873 25658 consensus_queue.cc:1035] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:30.163626 25633 consensus_queue.cc:1035] T 4fcf0c1ff88f41c681a940a3db368e1a P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:55:30.489784 25586 consensus_queue.cc:237] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:30.492599 25440 raft_consensus.cc:1261] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:30.492703 25515 raft_consensus.cc:1261] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:30.493083 26109 consensus_queue.cc:1035] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:30.493458 25680 consensus_queue.cc:1035] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:30.496412 26109 raft_consensus.cc:2932] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:30.497004 25517 raft_consensus.cc:2932] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:30.497488 25440 raft_consensus.cc:2932] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
W20240502 01:55:30.503635 25556 consensus_peers.cc:485] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f6789c3e6d44cff8e50f6a9af1a42e7. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:30.504858 25339 catalog_manager.cc:5484] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:30.511238 25517 consensus_queue.cc:237] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:30.513041 25586 raft_consensus.cc:1261] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:30.513499 25440 raft_consensus.cc:1261] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:30.513883 25718 consensus_queue.cc:1035] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:30.514309 25718 consensus_queue.cc:1035] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:30.516484 25718 raft_consensus.cc:2932] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:30.517077 25586 raft_consensus.cc:2932] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:30.520077 25440 raft_consensus.cc:2932] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:30.522122 25336 catalog_manager.cc:5484] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240502 01:55:30.523093 25482 consensus_peers.cc:485] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f53a683b23346ae963d62ef4c84bee8. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:30.524856 25517 consensus_queue.cc:237] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
W20240502 01:55:30.526708 25482 consensus_peers.cc:485] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bc6480138d14df397ca2db53ca652d2. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:30.527675 25590 raft_consensus.cc:1261] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:30.528155 25633 consensus_queue.cc:1035] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:30.529711 25440 raft_consensus.cc:1261] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:30.530122 25718 consensus_queue.cc:1035] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:30.530560 25718 raft_consensus.cc:2932] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:30.531849 25591 raft_consensus.cc:2932] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:30.535600 25337 catalog_manager.cc:5484] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:30.536453 25517 consensus_queue.cc:237] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:30.536592 25440 raft_consensus.cc:2932] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:30.545612 25591 raft_consensus.cc:1261] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:30.545715 25440 raft_consensus.cc:1261] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 01:55:30.545712 25482 consensus_peers.cc:485] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03251bf1c560469880b1ab407d24a810. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:30.546078 25770 consensus_queue.cc:1035] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:30.546661 25658 consensus_queue.cc:1035] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:30.549420 25770 raft_consensus.cc:2932] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:30.549963 25591 raft_consensus.cc:2932] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:30.549924 25440 raft_consensus.cc:2932] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:30.554066 25336 catalog_manager.cc:5484] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:30.878331 26128 ts_tablet_manager.cc:902] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:30.880102 26128 tablet_copy_client.cc:308] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.192.3:36291
I20240502 01:55:30.886299 25601 tablet_copy_service.cc:140] P a7ffa3e1ba614911a5fc9fafc38573f1: Received BeginTabletCopySession request for tablet 2f6789c3e6d44cff8e50f6a9af1a42e7 from peer e6f4ddf520ea4341adafe59ace70e6dc ({username='slave'} at 127.0.0.1:55186)
I20240502 01:55:30.886466 25601 tablet_copy_service.cc:161] P a7ffa3e1ba614911a5fc9fafc38573f1: Beginning new tablet copy session on tablet 2f6789c3e6d44cff8e50f6a9af1a42e7 from peer e6f4ddf520ea4341adafe59ace70e6dc at {username='slave'} at 127.0.0.1:55186: session id = e6f4ddf520ea4341adafe59ace70e6dc-2f6789c3e6d44cff8e50f6a9af1a42e7
I20240502 01:55:30.889840 25601 tablet_copy_source_session.cc:205] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:55:30.891579 26128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f6789c3e6d44cff8e50f6a9af1a42e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:30.897342 26128 tablet_copy_client.cc:783] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 0 data blocks...
I20240502 01:55:30.897643 26128 tablet_copy_client.cc:647] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 1 WAL segments...
I20240502 01:55:30.899636 26128 tablet_copy_client.cc:523] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:55:30.902922 26128 tablet_bootstrap.cc:492] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap starting.
I20240502 01:55:30.903952 26134 ts_tablet_manager.cc:902] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:30.907606 26134 tablet_copy_client.cc:308] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.192.2:37163
I20240502 01:55:30.911003 26128 tablet_bootstrap.cc:492] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:55:30.911386 26128 tablet_bootstrap.cc:492] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap complete.
I20240502 01:55:30.911608 26128 ts_tablet_manager.cc:1367] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent bootstrapping tablet: real 0.009s user 0.010s sys 0.001s
I20240502 01:55:30.912341 26128 raft_consensus.cc:348] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:30.912575 26128 raft_consensus.cc:729] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e6f4ddf520ea4341adafe59ace70e6dc, State: Initialized, Role: LEARNER
I20240502 01:55:30.912756 26128 consensus_queue.cc:260] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:30.913360 25527 tablet_copy_service.cc:140] P 77c36b03bf7c42a9a430cc595953aff9: Received BeginTabletCopySession request for tablet 1f53a683b23346ae963d62ef4c84bee8 from peer e6f4ddf520ea4341adafe59ace70e6dc ({username='slave'} at 127.0.0.1:46040)
I20240502 01:55:30.913501 25527 tablet_copy_service.cc:161] P 77c36b03bf7c42a9a430cc595953aff9: Beginning new tablet copy session on tablet 1f53a683b23346ae963d62ef4c84bee8 from peer e6f4ddf520ea4341adafe59ace70e6dc at {username='slave'} at 127.0.0.1:46040: session id = e6f4ddf520ea4341adafe59ace70e6dc-1f53a683b23346ae963d62ef4c84bee8
I20240502 01:55:30.913532 26100 heartbeater.cc:503] Master 127.23.192.62:43317 was elected leader, sending a full tablet report...
I20240502 01:55:30.913566 26128 ts_tablet_manager.cc:1398] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:30.914266 25601 tablet_copy_service.cc:342] P a7ffa3e1ba614911a5fc9fafc38573f1: Request end of tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-2f6789c3e6d44cff8e50f6a9af1a42e7 received from {username='slave'} at 127.0.0.1:55186
I20240502 01:55:30.914382 25601 tablet_copy_service.cc:433] P a7ffa3e1ba614911a5fc9fafc38573f1: ending tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-2f6789c3e6d44cff8e50f6a9af1a42e7 on tablet 2f6789c3e6d44cff8e50f6a9af1a42e7 with peer e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:30.916249 25527 tablet_copy_source_session.cc:205] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:55:30.917308 26134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f53a683b23346ae963d62ef4c84bee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:30.922334 26134 tablet_copy_client.cc:783] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 0 data blocks...
I20240502 01:55:30.922533 26134 tablet_copy_client.cc:647] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 1 WAL segments...
I20240502 01:55:30.924180 26134 tablet_copy_client.cc:523] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:55:30.926792 26134 tablet_bootstrap.cc:492] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap starting.
I20240502 01:55:30.931810 26134 tablet_bootstrap.cc:492] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:55:30.932101 26134 tablet_bootstrap.cc:492] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap complete.
I20240502 01:55:30.932312 26134 ts_tablet_manager.cc:1367] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20240502 01:55:30.932847 26134 raft_consensus.cc:348] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:30.933020 26134 raft_consensus.cc:729] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e6f4ddf520ea4341adafe59ace70e6dc, State: Initialized, Role: LEARNER
I20240502 01:55:30.933179 26134 consensus_queue.cc:260] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:30.933727 26134 ts_tablet_manager.cc:1398] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 01:55:30.936708 25527 tablet_copy_service.cc:342] P 77c36b03bf7c42a9a430cc595953aff9: Request end of tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-1f53a683b23346ae963d62ef4c84bee8 received from {username='slave'} at 127.0.0.1:46040
I20240502 01:55:30.936817 25527 tablet_copy_service.cc:433] P 77c36b03bf7c42a9a430cc595953aff9: ending tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-1f53a683b23346ae963d62ef4c84bee8 on tablet 1f53a683b23346ae963d62ef4c84bee8 with peer e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:30.995959 26134 ts_tablet_manager.cc:902] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:31.000933 26128 ts_tablet_manager.cc:902] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:31.009779 26134 tablet_copy_client.cc:308] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.192.2:37163
I20240502 01:55:31.010424 25527 tablet_copy_service.cc:140] P 77c36b03bf7c42a9a430cc595953aff9: Received BeginTabletCopySession request for tablet 6bc6480138d14df397ca2db53ca652d2 from peer e6f4ddf520ea4341adafe59ace70e6dc ({username='slave'} at 127.0.0.1:46040)
I20240502 01:55:31.010576 25527 tablet_copy_service.cc:161] P 77c36b03bf7c42a9a430cc595953aff9: Beginning new tablet copy session on tablet 6bc6480138d14df397ca2db53ca652d2 from peer e6f4ddf520ea4341adafe59ace70e6dc at {username='slave'} at 127.0.0.1:46040: session id = e6f4ddf520ea4341adafe59ace70e6dc-6bc6480138d14df397ca2db53ca652d2
I20240502 01:55:31.013000 25527 tablet_copy_source_session.cc:205] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:55:31.014051 26134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bc6480138d14df397ca2db53ca652d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:31.015082 26128 tablet_copy_client.cc:308] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.192.2:37163
I20240502 01:55:31.015588 25527 tablet_copy_service.cc:140] P 77c36b03bf7c42a9a430cc595953aff9: Received BeginTabletCopySession request for tablet 03251bf1c560469880b1ab407d24a810 from peer e6f4ddf520ea4341adafe59ace70e6dc ({username='slave'} at 127.0.0.1:46040)
I20240502 01:55:31.015714 25527 tablet_copy_service.cc:161] P 77c36b03bf7c42a9a430cc595953aff9: Beginning new tablet copy session on tablet 03251bf1c560469880b1ab407d24a810 from peer e6f4ddf520ea4341adafe59ace70e6dc at {username='slave'} at 127.0.0.1:46040: session id = e6f4ddf520ea4341adafe59ace70e6dc-03251bf1c560469880b1ab407d24a810
I20240502 01:55:31.017832 25527 tablet_copy_source_session.cc:205] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:55:31.018747 26128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03251bf1c560469880b1ab407d24a810. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:31.020681 26134 tablet_copy_client.cc:783] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 0 data blocks...
I20240502 01:55:31.020879 26134 tablet_copy_client.cc:647] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 1 WAL segments...
I20240502 01:55:31.022058 26134 tablet_copy_client.cc:523] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:55:31.024083 26128 tablet_copy_client.cc:783] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 0 data blocks...
I20240502 01:55:31.024273 26128 tablet_copy_client.cc:647] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 1 WAL segments...
I20240502 01:55:31.024583 26134 tablet_bootstrap.cc:492] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap starting.
I20240502 01:55:31.026042 26128 tablet_copy_client.cc:523] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:55:31.030007 26128 tablet_bootstrap.cc:492] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap starting.
I20240502 01:55:31.030630 26134 tablet_bootstrap.cc:492] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:55:31.031039 26134 tablet_bootstrap.cc:492] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap complete.
I20240502 01:55:31.031267 26134 ts_tablet_manager.cc:1367] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.004s
I20240502 01:55:31.031972 26134 raft_consensus.cc:348] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:31.032203 26134 raft_consensus.cc:729] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e6f4ddf520ea4341adafe59ace70e6dc, State: Initialized, Role: LEARNER
I20240502 01:55:31.032404 26134 consensus_queue.cc:260] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:31.033469 26134 ts_tablet_manager.cc:1398] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:55:31.034814 25527 tablet_copy_service.cc:342] P 77c36b03bf7c42a9a430cc595953aff9: Request end of tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-6bc6480138d14df397ca2db53ca652d2 received from {username='slave'} at 127.0.0.1:46040
I20240502 01:55:31.034926 25527 tablet_copy_service.cc:433] P 77c36b03bf7c42a9a430cc595953aff9: ending tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-6bc6480138d14df397ca2db53ca652d2 on tablet 6bc6480138d14df397ca2db53ca652d2 with peer e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:31.035846 26128 tablet_bootstrap.cc:492] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:55:31.036192 26128 tablet_bootstrap.cc:492] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap complete.
I20240502 01:55:31.036614 26128 ts_tablet_manager.cc:1367] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.003s
I20240502 01:55:31.037288 26128 raft_consensus.cc:348] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:31.037434 26128 raft_consensus.cc:729] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e6f4ddf520ea4341adafe59ace70e6dc, State: Initialized, Role: LEARNER
I20240502 01:55:31.037566 26128 consensus_queue.cc:260] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:31.038053 26128 ts_tablet_manager.cc:1398] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:55:31.038657 25527 tablet_copy_service.cc:342] P 77c36b03bf7c42a9a430cc595953aff9: Request end of tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-03251bf1c560469880b1ab407d24a810 received from {username='slave'} at 127.0.0.1:46040
I20240502 01:55:31.038750 25527 tablet_copy_service.cc:433] P 77c36b03bf7c42a9a430cc595953aff9: ending tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-03251bf1c560469880b1ab407d24a810 on tablet 03251bf1c560469880b1ab407d24a810 with peer e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:31.416527 26075 raft_consensus.cc:1203] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 01:55:31.474547 26075 raft_consensus.cc:1203] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 01:55:31.503650 26075 raft_consensus.cc:1203] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 01:55:31.579736 26075 raft_consensus.cc:1203] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 01:55:31.929628 26152 raft_consensus.cc:1050] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9: attempting to promote NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc to VOTER
I20240502 01:55:31.930575 26152 consensus_queue.cc:237] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:31.933746 26075 raft_consensus.cc:1261] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:31.933950 25442 raft_consensus.cc:1261] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:31.933746 25590 raft_consensus.cc:1261] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:31.934360 26152 consensus_queue.cc:1035] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:31.934963 25718 consensus_queue.cc:1035] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:31.935472 25658 consensus_queue.cc:1035] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:31.938328 25658 raft_consensus.cc:2932] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:31.940371 26075 raft_consensus.cc:2932] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:31.941851 25591 raft_consensus.cc:2932] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:31.941958 25442 raft_consensus.cc:2932] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:31.947844 25337 catalog_manager.cc:5484] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f reported cstate change: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:31.959139 25512 consensus_queue.cc:237] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:31.961143 25440 raft_consensus.cc:1261] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:31.961213 26075 raft_consensus.cc:1261] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:31.961642 25718 consensus_queue.cc:1035] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:31.963686 25718 consensus_queue.cc:1035] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:31.964815 25718 raft_consensus.cc:2932] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:31.966544 25440 raft_consensus.cc:2932] T 1f53a683b23346ae963d62ef4c84bee8 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:31.967396 26074 raft_consensus.cc:2932] T 1f53a683b23346ae963d62ef4c84bee8 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:31.968895 25325 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1f53a683b23346ae963d62ef4c84bee8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:55:31.971172 25338 catalog_manager.cc:5484] T 1f53a683b23346ae963d62ef4c84bee8 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: config changed from index 3 to 4, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:55:31.974920 25576 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f53a683b23346ae963d62ef4c84bee8 with delete_type TABLET_DATA_TOMBSTONED (TS a7ffa3e1ba614911a5fc9fafc38573f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45288
I20240502 01:55:31.975735 26162 tablet_replica.cc:330] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1: stopping tablet replica
I20240502 01:55:31.975934 26162 raft_consensus.cc:2229] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:31.976186 26162 raft_consensus.cc:2258] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:31.977540 26162 ts_tablet_manager.cc:1875] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:55:31.983397 26162 ts_tablet_manager.cc:1888] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 01:55:31.983515 26162 log.cc:1196] T 1f53a683b23346ae963d62ef4c84bee8 P a7ffa3e1ba614911a5fc9fafc38573f1: Deleting WAL directory at /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-2-root/wals/1f53a683b23346ae963d62ef4c84bee8
I20240502 01:55:31.984169 25326 catalog_manager.cc:4830] TS a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): tablet 1f53a683b23346ae963d62ef4c84bee8 (table test-workload [id=7946016b2fba4afc9a804f19dfe3daad]) successfully deleted
I20240502 01:55:32.011963 25718 raft_consensus.cc:1050] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9: attempting to promote NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc to VOTER
I20240502 01:55:32.012535 25718 consensus_queue.cc:237] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:32.014526 25591 raft_consensus.cc:1261] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:32.014536 26074 raft_consensus.cc:1261] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:32.015080 25440 raft_consensus.cc:1261] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:32.015295 25718 consensus_queue.cc:1035] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:32.015520 25658 consensus_queue.cc:1035] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:32.015759 26152 consensus_queue.cc:1035] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:32.018911 26152 raft_consensus.cc:2932] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.019618 25590 raft_consensus.cc:2932] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.024447 26074 raft_consensus.cc:2932] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.025175 25338 catalog_manager.cc:5484] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:55:32.030699 25512 consensus_queue.cc:237] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:32.033041 26074 raft_consensus.cc:1261] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:32.033046 25590 raft_consensus.cc:1261] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:32.033540 25718 consensus_queue.cc:1035] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:32.035744 25658 raft_consensus.cc:2932] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.036566 26075 raft_consensus.cc:2932] T 6bc6480138d14df397ca2db53ca652d2 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.041488 25338 catalog_manager.cc:5484] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:55:32.042168 25325 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 6bc6480138d14df397ca2db53ca652d2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:55:32.045471 25425 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bc6480138d14df397ca2db53ca652d2 with delete_type TABLET_DATA_TOMBSTONED (TS 481341cc6302403dab5dcc402f42a81f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60962
I20240502 01:55:32.057375 26168 tablet_replica.cc:330] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f: stopping tablet replica
I20240502 01:55:32.057600 26168 raft_consensus.cc:2229] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:32.057782 26168 pending_rounds.cc:62] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f: Trying to abort 1 pending ops.
I20240502 01:55:32.058048 26168 pending_rounds.cc:68] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7023062761522020352 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "6bc6480138d14df397ca2db53ca652d2" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } } }
I20240502 01:55:32.058336 26168 raft_consensus.cc:2894] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20240502 01:55:32.058430 26168 raft_consensus.cc:2866] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20240502 01:55:32.058514 26168 raft_consensus.cc:2258] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:32.064042 25718 consensus_queue.cc:1035] T 6bc6480138d14df397ca2db53ca652d2 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:32.064724 26168 ts_tablet_manager.cc:1875] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:55:32.069468 26168 ts_tablet_manager.cc:1888] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 01:55:32.069586 26168 log.cc:1196] T 6bc6480138d14df397ca2db53ca652d2 P 481341cc6302403dab5dcc402f42a81f: Deleting WAL directory at /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-0-root/wals/6bc6480138d14df397ca2db53ca652d2
I20240502 01:55:32.070143 25326 catalog_manager.cc:4830] TS 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): tablet 6bc6480138d14df397ca2db53ca652d2 (table test-workload [id=7946016b2fba4afc9a804f19dfe3daad]) successfully deleted
I20240502 01:55:32.070497 25590 raft_consensus.cc:2932] T 6bc6480138d14df397ca2db53ca652d2 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.074163 26153 raft_consensus.cc:1050] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1: attempting to promote NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc to VOTER
I20240502 01:55:32.074954 26153 consensus_queue.cc:237] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:32.075423 25718 raft_consensus.cc:1050] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9: attempting to promote NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc to VOTER
I20240502 01:55:32.076072 25718 consensus_queue.cc:237] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:32.077095 26074 raft_consensus.cc:1261] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:32.077286 25515 raft_consensus.cc:1261] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:32.077677 25788 consensus_queue.cc:1035] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:32.078197 25788 consensus_queue.cc:1035] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:32.085376 26075 raft_consensus.cc:1261] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:32.085284 25586 raft_consensus.cc:1261] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:32.086019 26167 consensus_queue.cc:1035] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:32.090484 25440 raft_consensus.cc:1261] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:32.090469 25718 consensus_queue.cc:1035] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:32.091027 25788 consensus_queue.cc:1035] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:32.093818 25442 raft_consensus.cc:1261] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:32.094501 25718 consensus_queue.cc:1035] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:32.095177 25788 raft_consensus.cc:2932] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.096271 25718 raft_consensus.cc:2932] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.097720 25440 raft_consensus.cc:2932] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.099408 26075 raft_consensus.cc:2932] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.101260 26074 raft_consensus.cc:2932] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.101352 25337 catalog_manager.cc:5484] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:55:32.103148 25338 catalog_manager.cc:5484] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc reported cstate change: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.106228 25586 consensus_queue.cc:237] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:32.109257 25437 raft_consensus.cc:2932] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.116256 25442 raft_consensus.cc:1261] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:32.117131 26153 consensus_queue.cc:1035] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:32.118186 26074 raft_consensus.cc:1261] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:32.118875 26170 consensus_queue.cc:1035] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:32.119113 25586 raft_consensus.cc:2932] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.120678 26178 raft_consensus.cc:2932] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.121842 25442 raft_consensus.cc:2932] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.122730 26074 raft_consensus.cc:2932] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.126873 25337 catalog_manager.cc:5484] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P e6f4ddf520ea4341adafe59ace70e6dc reported cstate change: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.128969 25515 consensus_queue.cc:237] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:32.129604 25326 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2f6789c3e6d44cff8e50f6a9af1a42e7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:55:32.130460 25507 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f6789c3e6d44cff8e50f6a9af1a42e7 with delete_type TABLET_DATA_TOMBSTONED (TS 77c36b03bf7c42a9a430cc595953aff9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42254
I20240502 01:55:32.131086 26182 tablet_replica.cc:330] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9: stopping tablet replica
I20240502 01:55:32.132047 26182 raft_consensus.cc:2229] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:32.132361 26182 pending_rounds.cc:62] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9: Trying to abort 1 pending ops.
I20240502 01:55:32.132460 26182 pending_rounds.cc:68] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7023062761776971776 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "2f6789c3e6d44cff8e50f6a9af1a42e7" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } } }
I20240502 01:55:32.132849 26182 raft_consensus.cc:2894] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20240502 01:55:32.133006 26182 raft_consensus.cc:2866] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20240502 01:55:32.133143 26182 raft_consensus.cc:2258] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:32.133775 25437 raft_consensus.cc:1261] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:32.134214 25658 consensus_queue.cc:1035] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:32.134963 26074 raft_consensus.cc:1261] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:32.135584 25718 consensus_queue.cc:1035] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:32.136783 26182 ts_tablet_manager.cc:1875] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:55:32.137717 25658 raft_consensus.cc:2932] T 03251bf1c560469880b1ab407d24a810 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.140069 25442 raft_consensus.cc:2932] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.141673 26074 raft_consensus.cc:2932] T 03251bf1c560469880b1ab407d24a810 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.143451 26182 ts_tablet_manager.cc:1888] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 01:55:32.143558 26182 log.cc:1196] T 2f6789c3e6d44cff8e50f6a9af1a42e7 P 77c36b03bf7c42a9a430cc595953aff9: Deleting WAL directory at /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-1-root/wals/2f6789c3e6d44cff8e50f6a9af1a42e7
I20240502 01:55:32.143690 25325 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 03251bf1c560469880b1ab407d24a810 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:55:32.144759 25325 catalog_manager.cc:4830] TS 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): tablet 2f6789c3e6d44cff8e50f6a9af1a42e7 (table test-workload [id=7946016b2fba4afc9a804f19dfe3daad]) successfully deleted
I20240502 01:55:32.145723 25337 catalog_manager.cc:5484] T 03251bf1c560469880b1ab407d24a810 P 481341cc6302403dab5dcc402f42a81f reported cstate change: config changed from index 3 to 4, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:32.149258 25576 tablet_service.cc:1514] Processing DeleteTablet for tablet 03251bf1c560469880b1ab407d24a810 with delete_type TABLET_DATA_TOMBSTONED (TS a7ffa3e1ba614911a5fc9fafc38573f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45288
I20240502 01:55:32.149547 26162 tablet_replica.cc:330] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1: stopping tablet replica
I20240502 01:55:32.149724 26162 raft_consensus.cc:2229] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:32.149947 26162 raft_consensus.cc:2258] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:32.150679 26162 ts_tablet_manager.cc:1875] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:55:32.154572 26162 ts_tablet_manager.cc:1888] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 01:55:32.154692 26162 log.cc:1196] T 03251bf1c560469880b1ab407d24a810 P a7ffa3e1ba614911a5fc9fafc38573f1: Deleting WAL directory at /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-2-root/wals/03251bf1c560469880b1ab407d24a810
I20240502 01:55:32.155259 25326 catalog_manager.cc:4830] TS a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): tablet 03251bf1c560469880b1ab407d24a810 (table test-workload [id=7946016b2fba4afc9a804f19dfe3daad]) successfully deleted
I20240502 01:55:33.164052 25515 consensus_queue.cc:237] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:33.166656 25590 raft_consensus.cc:1261] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 01:55:33.166656 25482 consensus_peers.cc:485] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8824314ff50341f4ac45b9d16bc2e338. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:33.167155 25718 consensus_queue.cc:1035] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:33.166767 25442 raft_consensus.cc:1261] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:33.168095 25718 consensus_queue.cc:1035] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:33.169891 26179 raft_consensus.cc:2932] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.171819 25442 raft_consensus.cc:2932] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.172530 25590 raft_consensus.cc:2932] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.176350 25336 catalog_manager.cc:5484] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.179117 25590 consensus_queue.cc:237] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:33.181026 25442 raft_consensus.cc:1261] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 01:55:33.181174 25556 consensus_peers.cc:485] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 568a8db50f33400992fff1ff0b3f9505. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:33.181478 26153 consensus_queue.cc:1035] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:33.182006 25515 raft_consensus.cc:1261] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:33.182943 26153 consensus_queue.cc:1035] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:33.188189 26178 raft_consensus.cc:2932] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.190418 25515 raft_consensus.cc:2932] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.210455 25437 raft_consensus.cc:2932] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.214128 25337 catalog_manager.cc:5484] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.218571 25437 consensus_queue.cc:237] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:33.220836 25586 raft_consensus.cc:1261] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:33.221138 25515 raft_consensus.cc:1261] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:33.221298 26183 consensus_queue.cc:1035] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:33.222167 26183 consensus_queue.cc:1035] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:33.224737 26181 raft_consensus.cc:2932] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.225418 25515 raft_consensus.cc:2932] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.228914 25590 consensus_queue.cc:237] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:33.231388 25336 catalog_manager.cc:5484] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
W20240502 01:55:33.233628 25556 consensus_peers.cc:485] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28f04f974e1b420f904c63cf6e1baa6b. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:33.233721 25515 raft_consensus.cc:1261] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:33.234040 25437 raft_consensus.cc:1261] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:33.234205 26190 consensus_queue.cc:1035] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:33.234619 26178 consensus_queue.cc:1035] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:33.236915 26190 raft_consensus.cc:2932] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.237883 25515 raft_consensus.cc:2932] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.238452 25442 raft_consensus.cc:2932] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:33.242350 25339 catalog_manager.cc:5484] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:33.247974 25586 raft_consensus.cc:2932] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
W20240502 01:55:33.255198 25406 consensus_peers.cc:485] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71689056867841e3aef8030fe4d2c58b. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:33.672060 26205 ts_tablet_manager.cc:902] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851)
I20240502 01:55:33.673458 26205 tablet_copy_client.cc:308] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.192.1:39851
I20240502 01:55:33.680212 25452 tablet_copy_service.cc:140] P 481341cc6302403dab5dcc402f42a81f: Received BeginTabletCopySession request for tablet 71689056867841e3aef8030fe4d2c58b from peer e6f4ddf520ea4341adafe59ace70e6dc ({username='slave'} at 127.0.0.1:36264)
I20240502 01:55:33.680353 25452 tablet_copy_service.cc:161] P 481341cc6302403dab5dcc402f42a81f: Beginning new tablet copy session on tablet 71689056867841e3aef8030fe4d2c58b from peer e6f4ddf520ea4341adafe59ace70e6dc at {username='slave'} at 127.0.0.1:36264: session id = e6f4ddf520ea4341adafe59ace70e6dc-71689056867841e3aef8030fe4d2c58b
I20240502 01:55:33.682925 25452 tablet_copy_source_session.cc:205] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:55:33.684027 26205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71689056867841e3aef8030fe4d2c58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:33.690282 26205 tablet_copy_client.cc:783] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 0 data blocks...
I20240502 01:55:33.690471 26205 tablet_copy_client.cc:647] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 1 WAL segments...
I20240502 01:55:33.692310 26205 tablet_copy_client.cc:523] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:55:33.694882 26205 tablet_bootstrap.cc:492] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap starting.
I20240502 01:55:33.698772 26211 ts_tablet_manager.cc:902] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:33.700155 26211 tablet_copy_client.cc:308] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.192.2:37163
I20240502 01:55:33.700822 25527 tablet_copy_service.cc:140] P 77c36b03bf7c42a9a430cc595953aff9: Received BeginTabletCopySession request for tablet 8824314ff50341f4ac45b9d16bc2e338 from peer e6f4ddf520ea4341adafe59ace70e6dc ({username='slave'} at 127.0.0.1:46040)
I20240502 01:55:33.700945 25527 tablet_copy_service.cc:161] P 77c36b03bf7c42a9a430cc595953aff9: Beginning new tablet copy session on tablet 8824314ff50341f4ac45b9d16bc2e338 from peer e6f4ddf520ea4341adafe59ace70e6dc at {username='slave'} at 127.0.0.1:46040: session id = e6f4ddf520ea4341adafe59ace70e6dc-8824314ff50341f4ac45b9d16bc2e338
I20240502 01:55:33.701172 26205 tablet_bootstrap.cc:492] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:55:33.701504 26205 tablet_bootstrap.cc:492] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap complete.
I20240502 01:55:33.701722 26205 ts_tablet_manager.cc:1367] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20240502 01:55:33.702277 26205 raft_consensus.cc:348] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:33.702447 26205 raft_consensus.cc:729] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e6f4ddf520ea4341adafe59ace70e6dc, State: Initialized, Role: LEARNER
I20240502 01:55:33.702618 26205 consensus_queue.cc:260] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:33.703006 25527 tablet_copy_source_session.cc:205] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:55:33.704384 26205 ts_tablet_manager.cc:1398] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 01:55:33.704741 26211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8824314ff50341f4ac45b9d16bc2e338. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:33.705510 25452 tablet_copy_service.cc:342] P 481341cc6302403dab5dcc402f42a81f: Request end of tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-71689056867841e3aef8030fe4d2c58b received from {username='slave'} at 127.0.0.1:36264
I20240502 01:55:33.705603 25452 tablet_copy_service.cc:433] P 481341cc6302403dab5dcc402f42a81f: ending tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-71689056867841e3aef8030fe4d2c58b on tablet 71689056867841e3aef8030fe4d2c58b with peer e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:33.708413 26218 ts_tablet_manager.cc:902] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:33.712062 26218 tablet_copy_client.cc:308] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.192.3:36291
I20240502 01:55:33.712654 25601 tablet_copy_service.cc:140] P a7ffa3e1ba614911a5fc9fafc38573f1: Received BeginTabletCopySession request for tablet 28f04f974e1b420f904c63cf6e1baa6b from peer e6f4ddf520ea4341adafe59ace70e6dc ({username='slave'} at 127.0.0.1:55186)
I20240502 01:55:33.712785 25601 tablet_copy_service.cc:161] P a7ffa3e1ba614911a5fc9fafc38573f1: Beginning new tablet copy session on tablet 28f04f974e1b420f904c63cf6e1baa6b from peer e6f4ddf520ea4341adafe59ace70e6dc at {username='slave'} at 127.0.0.1:55186: session id = e6f4ddf520ea4341adafe59ace70e6dc-28f04f974e1b420f904c63cf6e1baa6b
I20240502 01:55:33.715492 26211 tablet_copy_client.cc:783] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 0 data blocks...
I20240502 01:55:33.715517 25601 tablet_copy_source_session.cc:205] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:55:33.716135 26211 tablet_copy_client.cc:647] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 1 WAL segments...
I20240502 01:55:33.716600 26218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28f04f974e1b420f904c63cf6e1baa6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:33.718065 26211 tablet_copy_client.cc:523] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:55:33.721439 26211 tablet_bootstrap.cc:492] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap starting.
I20240502 01:55:33.723062 26218 tablet_copy_client.cc:783] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 0 data blocks...
I20240502 01:55:33.723233 26218 tablet_copy_client.cc:647] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 1 WAL segments...
I20240502 01:55:33.724668 26218 tablet_copy_client.cc:523] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:55:33.727123 26211 tablet_bootstrap.cc:492] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:55:33.727526 26211 tablet_bootstrap.cc:492] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap complete.
I20240502 01:55:33.727766 26211 ts_tablet_manager.cc:1367] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20240502 01:55:33.728449 26211 raft_consensus.cc:348] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:33.728657 26211 raft_consensus.cc:729] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e6f4ddf520ea4341adafe59ace70e6dc, State: Initialized, Role: LEARNER
I20240502 01:55:33.728821 26211 consensus_queue.cc:260] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:33.729401 26211 ts_tablet_manager.cc:1398] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:33.729543 26218 tablet_bootstrap.cc:492] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap starting.
I20240502 01:55:33.730088 25527 tablet_copy_service.cc:342] P 77c36b03bf7c42a9a430cc595953aff9: Request end of tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-8824314ff50341f4ac45b9d16bc2e338 received from {username='slave'} at 127.0.0.1:46040
I20240502 01:55:33.730190 25527 tablet_copy_service.cc:433] P 77c36b03bf7c42a9a430cc595953aff9: ending tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-8824314ff50341f4ac45b9d16bc2e338 on tablet 8824314ff50341f4ac45b9d16bc2e338 with peer e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:33.735994 26218 tablet_bootstrap.cc:492] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:55:33.736366 26218 tablet_bootstrap.cc:492] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap complete.
I20240502 01:55:33.736580 26218 ts_tablet_manager.cc:1367] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
I20240502 01:55:33.737291 26211 ts_tablet_manager.cc:902] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
I20240502 01:55:33.737834 26218 raft_consensus.cc:348] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:33.738080 26218 raft_consensus.cc:729] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e6f4ddf520ea4341adafe59ace70e6dc, State: Initialized, Role: LEARNER
I20240502 01:55:33.738276 26218 consensus_queue.cc:260] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:33.738935 26218 ts_tablet_manager.cc:1398] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 01:55:33.739471 26211 tablet_copy_client.cc:308] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.192.3:36291
I20240502 01:55:33.739640 25601 tablet_copy_service.cc:342] P a7ffa3e1ba614911a5fc9fafc38573f1: Request end of tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-28f04f974e1b420f904c63cf6e1baa6b received from {username='slave'} at 127.0.0.1:55186
I20240502 01:55:33.739715 25601 tablet_copy_service.cc:433] P a7ffa3e1ba614911a5fc9fafc38573f1: ending tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-28f04f974e1b420f904c63cf6e1baa6b on tablet 28f04f974e1b420f904c63cf6e1baa6b with peer e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:33.740231 25601 tablet_copy_service.cc:140] P a7ffa3e1ba614911a5fc9fafc38573f1: Received BeginTabletCopySession request for tablet 568a8db50f33400992fff1ff0b3f9505 from peer e6f4ddf520ea4341adafe59ace70e6dc ({username='slave'} at 127.0.0.1:55186)
I20240502 01:55:33.740370 25601 tablet_copy_service.cc:161] P a7ffa3e1ba614911a5fc9fafc38573f1: Beginning new tablet copy session on tablet 568a8db50f33400992fff1ff0b3f9505 from peer e6f4ddf520ea4341adafe59ace70e6dc at {username='slave'} at 127.0.0.1:55186: session id = e6f4ddf520ea4341adafe59ace70e6dc-568a8db50f33400992fff1ff0b3f9505
I20240502 01:55:33.742228 25601 tablet_copy_source_session.cc:205] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:55:33.743104 26211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 568a8db50f33400992fff1ff0b3f9505. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:33.748450 26211 tablet_copy_client.cc:783] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 0 data blocks...
I20240502 01:55:33.748696 26211 tablet_copy_client.cc:647] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 1 WAL segments...
I20240502 01:55:33.750213 26211 tablet_copy_client.cc:523] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:55:33.752789 26211 tablet_bootstrap.cc:492] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap starting.
I20240502 01:55:33.757419 26211 tablet_bootstrap.cc:492] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:55:33.757666 26211 tablet_bootstrap.cc:492] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap complete.
I20240502 01:55:33.757846 26211 ts_tablet_manager.cc:1367] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20240502 01:55:33.758337 26211 raft_consensus.cc:348] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:33.758545 26211 raft_consensus.cc:729] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e6f4ddf520ea4341adafe59ace70e6dc, State: Initialized, Role: LEARNER
I20240502 01:55:33.758729 26211 consensus_queue.cc:260] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:33.759219 26211 ts_tablet_manager.cc:1398] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 01:55:33.759938 25601 tablet_copy_service.cc:342] P a7ffa3e1ba614911a5fc9fafc38573f1: Request end of tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-568a8db50f33400992fff1ff0b3f9505 received from {username='slave'} at 127.0.0.1:55186
I20240502 01:55:33.760031 25601 tablet_copy_service.cc:433] P a7ffa3e1ba614911a5fc9fafc38573f1: ending tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-568a8db50f33400992fff1ff0b3f9505 on tablet 568a8db50f33400992fff1ff0b3f9505 with peer e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:34.082959 26074 raft_consensus.cc:1203] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 01:55:34.190992 26074 raft_consensus.cc:1203] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 01:55:34.255012 26074 raft_consensus.cc:1203] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 01:55:34.297060 26074 raft_consensus.cc:1203] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 01:55:34.655269 26181 raft_consensus.cc:1050] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f: attempting to promote NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc to VOTER
I20240502 01:55:34.656067 26181 consensus_queue.cc:237] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:34.658227 26074 raft_consensus.cc:1261] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:34.658371 25590 raft_consensus.cc:1261] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:34.658752 26181 consensus_queue.cc:1035] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:34.659579 25515 raft_consensus.cc:1261] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:34.659862 26183 consensus_queue.cc:1035] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:34.660089 26236 consensus_queue.cc:1035] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:34.663842 26183 raft_consensus.cc:2932] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.664292 26074 raft_consensus.cc:2932] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.668450 25590 raft_consensus.cc:2932] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.671051 25515 raft_consensus.cc:2932] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.671834 25336 catalog_manager.cc:5484] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f reported cstate change: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:55:34.680894 25442 consensus_queue.cc:237] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:34.682783 26074 raft_consensus.cc:1261] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:34.682816 25590 raft_consensus.cc:1261] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:34.683372 26240 consensus_queue.cc:1035] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:34.683624 26181 consensus_queue.cc:1035] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:34.685595 26236 raft_consensus.cc:2932] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.686643 26074 raft_consensus.cc:2932] T 71689056867841e3aef8030fe4d2c58b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.686865 25591 raft_consensus.cc:2932] T 71689056867841e3aef8030fe4d2c58b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.689069 25326 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 71689056867841e3aef8030fe4d2c58b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:55:34.690421 25337 catalog_manager.cc:5484] T 71689056867841e3aef8030fe4d2c58b P 481341cc6302403dab5dcc402f42a81f reported cstate change: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:55:34.693620 25507 tablet_service.cc:1514] Processing DeleteTablet for tablet 71689056867841e3aef8030fe4d2c58b with delete_type TABLET_DATA_TOMBSTONED (TS 77c36b03bf7c42a9a430cc595953aff9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42254
I20240502 01:55:34.698638 26234 raft_consensus.cc:1050] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1: attempting to promote NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc to VOTER
I20240502 01:55:34.699358 26234 consensus_queue.cc:237] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:34.703150 26245 tablet_replica.cc:330] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9: stopping tablet replica
I20240502 01:55:34.703315 26245 raft_consensus.cc:2229] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:34.703522 26245 raft_consensus.cc:2258] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:34.704147 26245 ts_tablet_manager.cc:1875] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:55:34.707862 26245 ts_tablet_manager.cc:1888] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 01:55:34.707962 26245 log.cc:1196] T 71689056867841e3aef8030fe4d2c58b P 77c36b03bf7c42a9a430cc595953aff9: Deleting WAL directory at /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-1-root/wals/71689056867841e3aef8030fe4d2c58b
I20240502 01:55:34.708505 26074 raft_consensus.cc:1261] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:34.708588 25325 catalog_manager.cc:4830] TS 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): tablet 71689056867841e3aef8030fe4d2c58b (table test-workload [id=7946016b2fba4afc9a804f19dfe3daad]) successfully deleted
I20240502 01:55:34.708837 25442 raft_consensus.cc:1261] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:34.709077 26190 consensus_queue.cc:1035] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:34.709529 26190 consensus_queue.cc:1035] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:34.711592 25515 raft_consensus.cc:1261] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:34.712244 26233 consensus_queue.cc:1035] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:34.716131 26232 raft_consensus.cc:1050] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9: attempting to promote NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc to VOTER
I20240502 01:55:34.716823 26232 consensus_queue.cc:237] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:34.717042 26234 raft_consensus.cc:2932] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.718756 25442 raft_consensus.cc:2932] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.718815 25512 raft_consensus.cc:2932] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.722330 26074 raft_consensus.cc:2932] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.722923 25591 raft_consensus.cc:1261] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:34.722980 25437 raft_consensus.cc:1261] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:34.723479 25718 consensus_queue.cc:1035] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:34.725127 25718 consensus_queue.cc:1035] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:34.727391 25339 catalog_manager.cc:5484] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f reported cstate change: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.728390 26075 raft_consensus.cc:1261] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:34.729305 25718 consensus_queue.cc:1035] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:34.734650 25590 consensus_queue.cc:237] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:34.738050 26075 raft_consensus.cc:1261] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:34.738512 25512 raft_consensus.cc:1261] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:34.739094 26233 consensus_queue.cc:1035] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:34.739636 26233 consensus_queue.cc:1035] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:34.741643 25590 raft_consensus.cc:2932] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.742749 26233 raft_consensus.cc:2932] T 28f04f974e1b420f904c63cf6e1baa6b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.742131 26073 raft_consensus.cc:2932] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.740938 26251 raft_consensus.cc:2932] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.746801 25512 raft_consensus.cc:2932] T 28f04f974e1b420f904c63cf6e1baa6b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.747956 25337 catalog_manager.cc:5484] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.749245 25326 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 28f04f974e1b420f904c63cf6e1baa6b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:55:34.749816 25442 raft_consensus.cc:2932] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.749966 26073 raft_consensus.cc:2932] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.757475 25339 catalog_manager.cc:5484] T 28f04f974e1b420f904c63cf6e1baa6b P e6f4ddf520ea4341adafe59ace70e6dc reported cstate change: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.758345 25512 consensus_queue.cc:237] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:34.760234 26073 raft_consensus.cc:1261] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:34.761059 26251 consensus_queue.cc:1035] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:34.762102 25425 tablet_service.cc:1514] Processing DeleteTablet for tablet 28f04f974e1b420f904c63cf6e1baa6b with delete_type TABLET_DATA_TOMBSTONED (TS 481341cc6302403dab5dcc402f42a81f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60962
I20240502 01:55:34.763231 25591 raft_consensus.cc:1261] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:34.764039 26179 consensus_queue.cc:1035] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:34.764158 26255 tablet_replica.cc:330] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f: stopping tablet replica
I20240502 01:55:34.764331 26255 raft_consensus.cc:2229] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:34.764813 26255 raft_consensus.cc:2258] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:34.764868 26251 raft_consensus.cc:2932] T 8824314ff50341f4ac45b9d16bc2e338 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.765457 26073 raft_consensus.cc:2932] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.765971 26255 ts_tablet_manager.cc:1875] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:55:34.770116 25325 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8824314ff50341f4ac45b9d16bc2e338 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:55:34.770474 25336 catalog_manager.cc:5484] T 8824314ff50341f4ac45b9d16bc2e338 P e6f4ddf520ea4341adafe59ace70e6dc reported cstate change: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.772747 26255 ts_tablet_manager.cc:1888] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 01:55:34.772847 26255 log.cc:1196] T 28f04f974e1b420f904c63cf6e1baa6b P 481341cc6302403dab5dcc402f42a81f: Deleting WAL directory at /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-0-root/wals/28f04f974e1b420f904c63cf6e1baa6b
I20240502 01:55:34.772557 25591 raft_consensus.cc:2932] T 8824314ff50341f4ac45b9d16bc2e338 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.773607 25326 catalog_manager.cc:4830] TS 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): tablet 28f04f974e1b420f904c63cf6e1baa6b (table test-workload [id=7946016b2fba4afc9a804f19dfe3daad]) successfully deleted
I20240502 01:55:34.776455 25425 tablet_service.cc:1514] Processing DeleteTablet for tablet 8824314ff50341f4ac45b9d16bc2e338 with delete_type TABLET_DATA_TOMBSTONED (TS 481341cc6302403dab5dcc402f42a81f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60962
I20240502 01:55:34.776793 26255 tablet_replica.cc:330] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f: stopping tablet replica
I20240502 01:55:34.776960 26255 raft_consensus.cc:2229] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:34.777177 26255 raft_consensus.cc:2258] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:34.777870 26255 ts_tablet_manager.cc:1875] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:55:34.782560 26255 ts_tablet_manager.cc:1888] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 01:55:34.782649 26255 log.cc:1196] T 8824314ff50341f4ac45b9d16bc2e338 P 481341cc6302403dab5dcc402f42a81f: Deleting WAL directory at /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-0-root/wals/8824314ff50341f4ac45b9d16bc2e338
I20240502 01:55:34.783222 25326 catalog_manager.cc:4830] TS 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): tablet 8824314ff50341f4ac45b9d16bc2e338 (table test-workload [id=7946016b2fba4afc9a804f19dfe3daad]) successfully deleted
I20240502 01:55:34.786965 26233 raft_consensus.cc:1050] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1: attempting to promote NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc to VOTER
I20240502 01:55:34.787645 26233 consensus_queue.cc:237] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:34.789422 26073 raft_consensus.cc:1261] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:34.789505 25515 raft_consensus.cc:1261] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:34.789898 26190 consensus_queue.cc:1035] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:34.790045 25442 raft_consensus.cc:1261] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:34.790622 26233 consensus_queue.cc:1035] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:34.790894 26190 consensus_queue.cc:1035] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:34.794463 26190 raft_consensus.cc:2932] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.795508 25442 raft_consensus.cc:2932] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.799257 26073 raft_consensus.cc:2932] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.800024 25339 catalog_manager.cc:5484] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:55:34.805465 25586 consensus_queue.cc:237] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:34.807094 25442 raft_consensus.cc:1261] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:34.807137 26073 raft_consensus.cc:1261] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:34.807534 26190 consensus_queue.cc:1035] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:34.807761 26233 consensus_queue.cc:1035] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:34.810619 26234 raft_consensus.cc:2932] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.811157 25442 raft_consensus.cc:2932] T 568a8db50f33400992fff1ff0b3f9505 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.811157 26073 raft_consensus.cc:2932] T 568a8db50f33400992fff1ff0b3f9505 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:34.814668 25326 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 568a8db50f33400992fff1ff0b3f9505 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:55:34.815702 25338 catalog_manager.cc:5484] T 568a8db50f33400992fff1ff0b3f9505 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:55:34.818667 25507 tablet_service.cc:1514] Processing DeleteTablet for tablet 568a8db50f33400992fff1ff0b3f9505 with delete_type TABLET_DATA_TOMBSTONED (TS 77c36b03bf7c42a9a430cc595953aff9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42254
I20240502 01:55:34.819849 26245 tablet_replica.cc:330] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9: stopping tablet replica
I20240502 01:55:34.820058 26245 raft_consensus.cc:2229] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:34.820212 26245 pending_rounds.cc:62] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9: Trying to abort 1 pending ops.
I20240502 01:55:34.820250 26245 pending_rounds.cc:68] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7023062772888334336 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "568a8db50f33400992fff1ff0b3f9505" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } } }
I20240502 01:55:34.820634 26245 raft_consensus.cc:2894] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20240502 01:55:34.820736 26245 raft_consensus.cc:2866] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20240502 01:55:34.820806 26245 raft_consensus.cc:2258] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:34.821679 26245 ts_tablet_manager.cc:1875] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:55:34.825731 26245 ts_tablet_manager.cc:1888] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 01:55:34.825809 26245 log.cc:1196] T 568a8db50f33400992fff1ff0b3f9505 P 77c36b03bf7c42a9a430cc595953aff9: Deleting WAL directory at /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-1-root/wals/568a8db50f33400992fff1ff0b3f9505
I20240502 01:55:34.826287 25325 catalog_manager.cc:4830] TS 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): tablet 568a8db50f33400992fff1ff0b3f9505 (table test-workload [id=7946016b2fba4afc9a804f19dfe3daad]) successfully deleted
I20240502 01:55:35.834425 25437 consensus_queue.cc:237] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:35.836489 25515 raft_consensus.cc:1261] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 3 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20240502 01:55:35.836779 25406 consensus_peers.cc:485] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b64e37777a0493aa438b49a92d9f4fd. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:35.836781 25586 raft_consensus.cc:1261] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 3 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240502 01:55:35.837134 26265 consensus_queue.cc:1035] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:35.837414 26263 consensus_queue.cc:1035] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:35.839859 26263 raft_consensus.cc:2932] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.840384 25515 raft_consensus.cc:2932] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.844235 25437 consensus_queue.cc:237] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:35.845242 25339 catalog_manager.cc:5484] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: config changed from index -1 to 3, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 3 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.846375 25586 raft_consensus.cc:2932] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.846803 25591 raft_consensus.cc:1261] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 01:55:35.847146 25406 consensus_peers.cc:485] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de09870b6fba4a19bf37028fea65f5bd. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:35.847359 26265 consensus_queue.cc:1035] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:35.846750 25515 raft_consensus.cc:1261] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:35.850745 26263 consensus_queue.cc:1035] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:35.851217 26271 raft_consensus.cc:2932] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.853533 25512 raft_consensus.cc:2932] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.858145 25586 raft_consensus.cc:2932] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.859277 25515 consensus_queue.cc:237] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
W20240502 01:55:35.861464 25482 consensus_peers.cc:485] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ddecb61ec374e229ae91cda1bfbd6c5. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:35.862263 25442 raft_consensus.cc:1261] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:35.862509 25591 raft_consensus.cc:1261] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:35.862711 26179 consensus_queue.cc:1035] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:35.863216 26179 consensus_queue.cc:1035] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:35.867043 26179 raft_consensus.cc:2932] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.869503 25591 raft_consensus.cc:2932] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.870229 25336 catalog_manager.cc:5484] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.876056 25442 raft_consensus.cc:2932] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.876480 25437 consensus_queue.cc:237] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:35.876955 25336 catalog_manager.cc:5484] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.881448 25591 raft_consensus.cc:1261] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:35.881773 25512 raft_consensus.cc:1261] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:35.881883 26271 consensus_queue.cc:1035] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:35.882355 26271 consensus_queue.cc:1035] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240502 01:55:35.882606 25406 consensus_peers.cc:485] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1721db9e2cf341f98bad0f77824788ff. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:35.885918 26263 raft_consensus.cc:2932] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.887080 25512 raft_consensus.cc:2932] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.889544 25591 raft_consensus.cc:2932] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:35.893004 25336 catalog_manager.cc:5484] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:36.233318 26284 ts_tablet_manager.cc:902] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851)
I20240502 01:55:36.235404 26284 tablet_copy_client.cc:308] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.192.1:39851
I20240502 01:55:36.236279 25452 tablet_copy_service.cc:140] P 481341cc6302403dab5dcc402f42a81f: Received BeginTabletCopySession request for tablet 5b64e37777a0493aa438b49a92d9f4fd from peer e6f4ddf520ea4341adafe59ace70e6dc ({username='slave'} at 127.0.0.1:36264)
I20240502 01:55:36.236399 25452 tablet_copy_service.cc:161] P 481341cc6302403dab5dcc402f42a81f: Beginning new tablet copy session on tablet 5b64e37777a0493aa438b49a92d9f4fd from peer e6f4ddf520ea4341adafe59ace70e6dc at {username='slave'} at 127.0.0.1:36264: session id = e6f4ddf520ea4341adafe59ace70e6dc-5b64e37777a0493aa438b49a92d9f4fd
I20240502 01:55:36.238719 25452 tablet_copy_source_session.cc:205] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:55:36.239823 26284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b64e37777a0493aa438b49a92d9f4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:36.245025 26284 tablet_copy_client.cc:783] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 0 data blocks...
I20240502 01:55:36.245275 26284 tablet_copy_client.cc:647] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 1 WAL segments...
I20240502 01:55:36.246637 26284 tablet_copy_client.cc:523] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:55:36.248790 26284 tablet_bootstrap.cc:492] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap starting.
I20240502 01:55:36.253280 26284 tablet_bootstrap.cc:492] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:55:36.253607 26284 tablet_bootstrap.cc:492] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap complete.
I20240502 01:55:36.253806 26284 ts_tablet_manager.cc:1367] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:55:36.254364 26284 raft_consensus.cc:348] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:36.254585 26284 raft_consensus.cc:729] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: e6f4ddf520ea4341adafe59ace70e6dc, State: Initialized, Role: LEARNER
I20240502 01:55:36.254765 26284 consensus_queue.cc:260] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:36.255499 26284 ts_tablet_manager.cc:1398] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 01:55:36.256165 25452 tablet_copy_service.cc:342] P 481341cc6302403dab5dcc402f42a81f: Request end of tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-5b64e37777a0493aa438b49a92d9f4fd received from {username='slave'} at 127.0.0.1:36264
I20240502 01:55:36.256248 25452 tablet_copy_service.cc:433] P 481341cc6302403dab5dcc402f42a81f: ending tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-5b64e37777a0493aa438b49a92d9f4fd on tablet 5b64e37777a0493aa438b49a92d9f4fd with peer e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:36.331401 26284 ts_tablet_manager.cc:902] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851)
I20240502 01:55:36.333184 26284 tablet_copy_client.cc:308] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.192.1:39851
I20240502 01:55:36.333751 25452 tablet_copy_service.cc:140] P 481341cc6302403dab5dcc402f42a81f: Received BeginTabletCopySession request for tablet 1721db9e2cf341f98bad0f77824788ff from peer e6f4ddf520ea4341adafe59ace70e6dc ({username='slave'} at 127.0.0.1:36264)
I20240502 01:55:36.333899 25452 tablet_copy_service.cc:161] P 481341cc6302403dab5dcc402f42a81f: Beginning new tablet copy session on tablet 1721db9e2cf341f98bad0f77824788ff from peer e6f4ddf520ea4341adafe59ace70e6dc at {username='slave'} at 127.0.0.1:36264: session id = e6f4ddf520ea4341adafe59ace70e6dc-1721db9e2cf341f98bad0f77824788ff
I20240502 01:55:36.336087 25452 tablet_copy_source_session.cc:205] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:55:36.337472 26296 ts_tablet_manager.cc:902] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
I20240502 01:55:36.337913 26284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1721db9e2cf341f98bad0f77824788ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:36.339138 26295 ts_tablet_manager.cc:902] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851)
I20240502 01:55:36.345324 26284 tablet_copy_client.cc:783] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 0 data blocks...
I20240502 01:55:36.345574 26284 tablet_copy_client.cc:647] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 1 WAL segments...
I20240502 01:55:36.347044 26284 tablet_copy_client.cc:523] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:55:36.351207 26296 tablet_copy_client.cc:308] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.192.2:37163
I20240502 01:55:36.351893 25527 tablet_copy_service.cc:140] P 77c36b03bf7c42a9a430cc595953aff9: Received BeginTabletCopySession request for tablet 4ddecb61ec374e229ae91cda1bfbd6c5 from peer e6f4ddf520ea4341adafe59ace70e6dc ({username='slave'} at 127.0.0.1:46040)
I20240502 01:55:36.352031 25527 tablet_copy_service.cc:161] P 77c36b03bf7c42a9a430cc595953aff9: Beginning new tablet copy session on tablet 4ddecb61ec374e229ae91cda1bfbd6c5 from peer e6f4ddf520ea4341adafe59ace70e6dc at {username='slave'} at 127.0.0.1:46040: session id = e6f4ddf520ea4341adafe59ace70e6dc-4ddecb61ec374e229ae91cda1bfbd6c5
I20240502 01:55:36.355005 25527 tablet_copy_source_session.cc:205] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:55:36.356096 26296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ddecb61ec374e229ae91cda1bfbd6c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:36.356251 26284 tablet_bootstrap.cc:492] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap starting.
I20240502 01:55:36.365165 26295 tablet_copy_client.cc:308] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Beginning tablet copy session from remote peer at address 127.23.192.1:39851
I20240502 01:55:36.365762 25452 tablet_copy_service.cc:140] P 481341cc6302403dab5dcc402f42a81f: Received BeginTabletCopySession request for tablet de09870b6fba4a19bf37028fea65f5bd from peer e6f4ddf520ea4341adafe59ace70e6dc ({username='slave'} at 127.0.0.1:36264)
I20240502 01:55:36.365906 25452 tablet_copy_service.cc:161] P 481341cc6302403dab5dcc402f42a81f: Beginning new tablet copy session on tablet de09870b6fba4a19bf37028fea65f5bd from peer e6f4ddf520ea4341adafe59ace70e6dc at {username='slave'} at 127.0.0.1:36264: session id = e6f4ddf520ea4341adafe59ace70e6dc-de09870b6fba4a19bf37028fea65f5bd
I20240502 01:55:36.366439 26296 tablet_copy_client.cc:783] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 0 data blocks...
I20240502 01:55:36.366670 26296 tablet_copy_client.cc:647] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 1 WAL segments...
I20240502 01:55:36.368124 25452 tablet_copy_source_session.cc:205] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:55:36.368543 26296 tablet_copy_client.cc:523] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:55:36.369031 26295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de09870b6fba4a19bf37028fea65f5bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:55:36.372011 26296 tablet_bootstrap.cc:492] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap starting.
I20240502 01:55:36.374711 26295 tablet_copy_client.cc:783] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 0 data blocks...
I20240502 01:55:36.374910 26295 tablet_copy_client.cc:647] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Starting download of 1 WAL segments...
I20240502 01:55:36.376173 26284 tablet_bootstrap.cc:492] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:55:36.376681 26295 tablet_copy_client.cc:523] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:55:36.377683 26284 tablet_bootstrap.cc:492] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap complete.
I20240502 01:55:36.377935 26284 ts_tablet_manager.cc:1367] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.004s
I20240502 01:55:36.378716 26284 raft_consensus.cc:348] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:36.378993 26284 raft_consensus.cc:729] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e6f4ddf520ea4341adafe59ace70e6dc, State: Initialized, Role: LEARNER
I20240502 01:55:36.379173 26284 consensus_queue.cc:260] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:36.379537 26296 tablet_bootstrap.cc:492] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:55:36.380445 26284 ts_tablet_manager.cc:1398] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:55:36.380694 26295 tablet_bootstrap.cc:492] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap starting.
I20240502 01:55:36.381367 25452 tablet_copy_service.cc:342] P 481341cc6302403dab5dcc402f42a81f: Request end of tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-1721db9e2cf341f98bad0f77824788ff received from {username='slave'} at 127.0.0.1:36264
I20240502 01:55:36.381464 25452 tablet_copy_service.cc:433] P 481341cc6302403dab5dcc402f42a81f: ending tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-1721db9e2cf341f98bad0f77824788ff on tablet 1721db9e2cf341f98bad0f77824788ff with peer e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:36.382262 26296 tablet_bootstrap.cc:492] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap complete.
I20240502 01:55:36.383924 26296 ts_tablet_manager.cc:1367] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.006s
I20240502 01:55:36.384557 26296 raft_consensus.cc:348] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:36.384768 26296 raft_consensus.cc:729] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e6f4ddf520ea4341adafe59ace70e6dc, State: Initialized, Role: LEARNER
I20240502 01:55:36.384963 26296 consensus_queue.cc:260] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:36.385491 26296 ts_tablet_manager.cc:1398] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:36.386065 25527 tablet_copy_service.cc:342] P 77c36b03bf7c42a9a430cc595953aff9: Request end of tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-4ddecb61ec374e229ae91cda1bfbd6c5 received from {username='slave'} at 127.0.0.1:46040
I20240502 01:55:36.386162 25527 tablet_copy_service.cc:433] P 77c36b03bf7c42a9a430cc595953aff9: ending tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-4ddecb61ec374e229ae91cda1bfbd6c5 on tablet 4ddecb61ec374e229ae91cda1bfbd6c5 with peer e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:36.386896 26295 tablet_bootstrap.cc:492] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:55:36.387197 26295 tablet_bootstrap.cc:492] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc: Bootstrap complete.
I20240502 01:55:36.387436 26295 ts_tablet_manager.cc:1367] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
I20240502 01:55:36.388146 26295 raft_consensus.cc:348] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:36.388350 26295 raft_consensus.cc:729] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e6f4ddf520ea4341adafe59ace70e6dc, State: Initialized, Role: LEARNER
I20240502 01:55:36.388531 26295 consensus_queue.cc:260] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:36.388976 26295 ts_tablet_manager.cc:1398] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:55:36.389503 25452 tablet_copy_service.cc:342] P 481341cc6302403dab5dcc402f42a81f: Request end of tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-de09870b6fba4a19bf37028fea65f5bd received from {username='slave'} at 127.0.0.1:36264
I20240502 01:55:36.389600 25452 tablet_copy_service.cc:433] P 481341cc6302403dab5dcc402f42a81f: ending tablet copy session e6f4ddf520ea4341adafe59ace70e6dc-de09870b6fba4a19bf37028fea65f5bd on tablet de09870b6fba4a19bf37028fea65f5bd with peer e6f4ddf520ea4341adafe59ace70e6dc
I20240502 01:55:36.724452 26073 raft_consensus.cc:1203] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 01:55:36.741014 26073 raft_consensus.cc:1203] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
I20240502 01:55:36.868037 26073 raft_consensus.cc:1203] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 01:55:36.907014 26073 raft_consensus.cc:1203] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 01:55:37.285111 26308 raft_consensus.cc:1050] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9: attempting to promote NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc to VOTER
I20240502 01:55:37.285880 26308 consensus_queue.cc:237] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:37.294953 26263 raft_consensus.cc:1050] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f: attempting to promote NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc to VOTER
I20240502 01:55:37.295732 26263 consensus_queue.cc:237] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
W20240502 01:55:37.296051 26271 consensus_queue.cc:1159] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "77c36b03bf7c42a9a430cc595953aff9" responder_term: 1 status { last_received { term: 1 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 1 index: 2 } }
I20240502 01:55:37.298487 25591 raft_consensus.cc:1261] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:37.298604 26075 raft_consensus.cc:1261] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:37.298487 26073 raft_consensus.cc:1261] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:37.299461 26280 consensus_queue.cc:1035] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:37.299978 25517 raft_consensus.cc:1261] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:37.300803 25586 raft_consensus.cc:1261] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:37.301159 26271 consensus_queue.cc:1035] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:37.301679 26271 consensus_queue.cc:1035] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:37.302122 26271 consensus_queue.cc:1035] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:37.314596 26314 consensus_queue.cc:1035] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:37.319799 26312 raft_consensus.cc:2932] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.321499 25437 raft_consensus.cc:1261] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:37.322258 26308 consensus_queue.cc:1035] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:37.324502 25515 raft_consensus.cc:2932] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.325177 26271 raft_consensus.cc:1050] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f: attempting to promote NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc to VOTER
I20240502 01:55:37.325443 25586 raft_consensus.cc:2932] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.325843 26271 consensus_queue.cc:237] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:37.330272 26075 raft_consensus.cc:2932] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.332082 25339 catalog_manager.cc:5484] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.344549 26075 raft_consensus.cc:1261] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc [term 3 LEARNER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20240502 01:55:37.344575 25586 raft_consensus.cc:1261] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 3 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20240502 01:55:37.344616 25515 raft_consensus.cc:1261] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 3 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20240502 01:55:37.345402 26312 consensus_queue.cc:1035] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:37.345669 26324 consensus_queue.cc:1035] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:37.345975 26271 consensus_queue.cc:1035] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:37.355937 26312 raft_consensus.cc:2932] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.359928 25515 raft_consensus.cc:2932] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.363191 26075 raft_consensus.cc:2932] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.366169 25586 raft_consensus.cc:2932] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.367889 25437 raft_consensus.cc:2932] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.366389 26319 raft_consensus.cc:2932] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.368944 25591 raft_consensus.cc:2932] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.373373 26073 raft_consensus.cc:2932] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.387017 25337 catalog_manager.cc:5484] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.387549 25337 catalog_manager.cc:5484] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index 3 to 4, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.393162 25437 consensus_queue.cc:237] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:37.394577 25515 consensus_queue.cc:237] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:37.395745 26073 raft_consensus.cc:1261] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:37.396294 26271 consensus_queue.cc:1035] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:37.396860 25586 raft_consensus.cc:1261] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:37.397538 25591 raft_consensus.cc:1261] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:37.397085 26073 raft_consensus.cc:1261] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:37.398499 26272 consensus_queue.cc:1035] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:37.399134 26319 consensus_queue.cc:1035] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:37.400568 26324 raft_consensus.cc:2932] T de09870b6fba4a19bf37028fea65f5bd P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.400118 25442 consensus_queue.cc:237] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:37.401804 25590 raft_consensus.cc:2932] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.404791 26319 consensus_queue.cc:1035] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:37.405298 26073 raft_consensus.cc:1261] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc [term 3 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20240502 01:55:37.405980 26272 consensus_queue.cc:1035] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:55:37.406625 25339 catalog_manager.cc:5484] T de09870b6fba4a19bf37028fea65f5bd P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.407685 25326 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet de09870b6fba4a19bf37028fea65f5bd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:55:37.408083 25515 raft_consensus.cc:1261] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 3 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20240502 01:55:37.408147 26074 raft_consensus.cc:2932] T de09870b6fba4a19bf37028fea65f5bd P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.408605 26263 raft_consensus.cc:2932] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.410586 26280 raft_consensus.cc:2932] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.411054 26073 raft_consensus.cc:2932] T 4ddecb61ec374e229ae91cda1bfbd6c5 P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.411392 26312 consensus_queue.cc:1035] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:55:37.412221 26074 raft_consensus.cc:2932] T 5b64e37777a0493aa438b49a92d9f4fd P e6f4ddf520ea4341adafe59ace70e6dc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.415227 25325 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 4ddecb61ec374e229ae91cda1bfbd6c5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:55:37.415323 25590 raft_consensus.cc:2932] T 4ddecb61ec374e229ae91cda1bfbd6c5 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.416982 25326 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 5b64e37777a0493aa438b49a92d9f4fd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:55:37.417347 25507 tablet_service.cc:1514] Processing DeleteTablet for tablet de09870b6fba4a19bf37028fea65f5bd with delete_type TABLET_DATA_TOMBSTONED (TS 77c36b03bf7c42a9a430cc595953aff9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42254
I20240502 01:55:37.422207 25339 catalog_manager.cc:5484] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: config changed from index 3 to 4, VOTER 481341cc6302403dab5dcc402f42a81f (127.23.192.1) evicted. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:55:37.422614 25337 catalog_manager.cc:5484] T 5b64e37777a0493aa438b49a92d9f4fd P 481341cc6302403dab5dcc402f42a81f reported cstate change: config changed from index 4 to 5, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New cstate: current_term: 3 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:55:37.426028 25515 raft_consensus.cc:2932] T 5b64e37777a0493aa438b49a92d9f4fd P 77c36b03bf7c42a9a430cc595953aff9 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.429394 25576 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b64e37777a0493aa438b49a92d9f4fd with delete_type TABLET_DATA_TOMBSTONED (TS a7ffa3e1ba614911a5fc9fafc38573f1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45288
I20240502 01:55:37.430367 26334 tablet_replica.cc:330] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1: stopping tablet replica
I20240502 01:55:37.430809 26332 tablet_replica.cc:330] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9: stopping tablet replica
I20240502 01:55:37.430964 26334 raft_consensus.cc:2229] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:37.431018 26332 raft_consensus.cc:2229] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:37.431268 26334 raft_consensus.cc:2258] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:37.431285 26332 raft_consensus.cc:2258] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:37.432101 26332 ts_tablet_manager.cc:1875] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:55:37.432183 26334 ts_tablet_manager.cc:1875] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:55:37.434605 25425 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ddecb61ec374e229ae91cda1bfbd6c5 with delete_type TABLET_DATA_TOMBSTONED (TS 481341cc6302403dab5dcc402f42a81f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60962
I20240502 01:55:37.441161 26334 ts_tablet_manager.cc:1888] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20240502 01:55:37.441272 26334 log.cc:1196] T 5b64e37777a0493aa438b49a92d9f4fd P a7ffa3e1ba614911a5fc9fafc38573f1: Deleting WAL directory at /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-2-root/wals/5b64e37777a0493aa438b49a92d9f4fd
I20240502 01:55:37.442248 25326 catalog_manager.cc:4830] TS a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): tablet 5b64e37777a0493aa438b49a92d9f4fd (table test-workload [id=7946016b2fba4afc9a804f19dfe3daad]) successfully deleted
I20240502 01:55:37.448283 26332 ts_tablet_manager.cc:1888] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 01:55:37.448391 26332 log.cc:1196] T de09870b6fba4a19bf37028fea65f5bd P 77c36b03bf7c42a9a430cc595953aff9: Deleting WAL directory at /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-1-root/wals/de09870b6fba4a19bf37028fea65f5bd
I20240502 01:55:37.449043 25325 catalog_manager.cc:4830] TS 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163): tablet de09870b6fba4a19bf37028fea65f5bd (table test-workload [id=7946016b2fba4afc9a804f19dfe3daad]) successfully deleted
I20240502 01:55:37.451231 26335 tablet_replica.cc:330] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f: stopping tablet replica
I20240502 01:55:37.451442 26335 raft_consensus.cc:2229] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:37.451740 26335 raft_consensus.cc:2258] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:37.452443 26335 ts_tablet_manager.cc:1875] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:55:37.457916 26335 ts_tablet_manager.cc:1888] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 01:55:37.458020 26335 log.cc:1196] T 4ddecb61ec374e229ae91cda1bfbd6c5 P 481341cc6302403dab5dcc402f42a81f: Deleting WAL directory at /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-0-root/wals/4ddecb61ec374e229ae91cda1bfbd6c5
I20240502 01:55:37.458691 25326 catalog_manager.cc:4830] TS 481341cc6302403dab5dcc402f42a81f (127.23.192.1:39851): tablet 4ddecb61ec374e229ae91cda1bfbd6c5 (table test-workload [id=7946016b2fba4afc9a804f19dfe3daad]) successfully deleted
I20240502 01:55:37.462059 26263 raft_consensus.cc:1050] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f: attempting to promote NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc to VOTER
I20240502 01:55:37.462853 26263 consensus_queue.cc:237] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:37.465128 25590 raft_consensus.cc:1261] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:37.465361 26074 raft_consensus.cc:1261] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc [term 1 LEARNER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:37.465467 25515 raft_consensus.cc:1261] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:55:37.465729 26271 consensus_queue.cc:1035] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:37.466048 26263 consensus_queue.cc:1035] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:37.466327 26312 consensus_queue.cc:1035] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:55:37.470145 26312 raft_consensus.cc:2932] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.470880 26074 raft_consensus.cc:2932] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.471671 25515 raft_consensus.cc:2932] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.474136 25590 raft_consensus.cc:2932] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.477695 25338 catalog_manager.cc:5484] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f reported cstate change: config changed from index 2 to 3, e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:55:37.482015 25437 consensus_queue.cc:237] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } }
I20240502 01:55:37.484038 26074 raft_consensus.cc:1261] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:37.484736 25515 raft_consensus.cc:1261] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer 481341cc6302403dab5dcc402f42a81f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:55:37.485261 26324 consensus_queue.cc:1035] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:37.485797 26272 consensus_queue.cc:1035] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:55:37.487392 26324 raft_consensus.cc:2932] T 1721db9e2cf341f98bad0f77824788ff P 481341cc6302403dab5dcc402f42a81f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.487959 26075 raft_consensus.cc:2932] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.490020 25326 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1721db9e2cf341f98bad0f77824788ff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:55:37.491235 25512 raft_consensus.cc:2932] T 1721db9e2cf341f98bad0f77824788ff P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.492111 25336 catalog_manager.cc:5484] T 1721db9e2cf341f98bad0f77824788ff P e6f4ddf520ea4341adafe59ace70e6dc reported cstate change: config changed from index 3 to 4, VOTER a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3) evicted. New cstate: current_term: 1 leader_uuid: "481341cc6302403dab5dcc402f42a81f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: false } } }
I20240502 01:55:37.495978 25576 tablet_service.cc:1514] Processing DeleteTablet for tablet 1721db9e2cf341f98bad0f77824788ff with delete_type TABLET_DATA_TOMBSTONED (TS a7ffa3e1ba614911a5fc9fafc38573f1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45288
I20240502 01:55:37.496246 26334 tablet_replica.cc:330] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1: stopping tablet replica
I20240502 01:55:37.496399 26334 raft_consensus.cc:2229] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:55:37.496596 26334 raft_consensus.cc:2258] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:55:37.497262 26334 ts_tablet_manager.cc:1875] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:55:37.501159 26334 ts_tablet_manager.cc:1888] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 01:55:37.501247 26334 log.cc:1196] T 1721db9e2cf341f98bad0f77824788ff P a7ffa3e1ba614911a5fc9fafc38573f1: Deleting WAL directory at /tmp/dist-test-task0Vxwx8/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714614871514479-24320-0/minicluster-data/ts-2-root/wals/1721db9e2cf341f98bad0f77824788ff
I20240502 01:55:37.501811 25326 catalog_manager.cc:4830] TS a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291): tablet 1721db9e2cf341f98bad0f77824788ff (table test-workload [id=7946016b2fba4afc9a804f19dfe3daad]) successfully deleted
I20240502 01:55:38.510643 25590 consensus_queue.cc:237] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:38.512715 25437 raft_consensus.cc:1261] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:38.512826 25515 raft_consensus.cc:1261] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:38.513334 26260 consensus_queue.cc:1035] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240502 01:55:38.513695 25556 consensus_peers.cc:485] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9fa192ac75ca4897be4bed9594502e7b. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:38.513892 26343 consensus_queue.cc:1035] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:38.515899 26260 raft_consensus.cc:2932] T 9fa192ac75ca4897be4bed9594502e7b P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.516522 25515 raft_consensus.cc:2932] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.521430 25515 consensus_queue.cc:237] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:38.522050 25336 catalog_manager.cc:5484] T 9fa192ac75ca4897be4bed9594502e7b P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.521622 25437 raft_consensus.cc:2932] T 9fa192ac75ca4897be4bed9594502e7b P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } attrs { replace: true } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.524183 25440 raft_consensus.cc:1261] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:38.524314 25590 raft_consensus.cc:1261] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Refusing update from remote peer 77c36b03bf7c42a9a430cc595953aff9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 01:55:38.524508 25482 consensus_peers.cc:485] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 325a9997b7724b7a999511469e0cf9da. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:38.524878 26340 consensus_queue.cc:1035] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:38.525154 26280 consensus_queue.cc:1035] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:38.528323 26340 raft_consensus.cc:2932] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.532132 25590 raft_consensus.cc:2932] T 325a9997b7724b7a999511469e0cf9da P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.534094 25591 consensus_queue.cc:237] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:38.534011 25337 catalog_manager.cc:5484] T 325a9997b7724b7a999511469e0cf9da P 77c36b03bf7c42a9a430cc595953aff9 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "77c36b03bf7c42a9a430cc595953aff9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:38.540593 25437 raft_consensus.cc:1261] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:38.540637 25515 raft_consensus.cc:1261] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 01:55:38.541110 25556 consensus_peers.cc:485] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b90778aac3294e6c913dfe12245b17e1. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:38.541123 26260 consensus_queue.cc:1035] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:38.541419 26341 consensus_queue.cc:1035] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:38.544240 25437 raft_consensus.cc:2932] T 325a9997b7724b7a999511469e0cf9da P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } attrs { replace: true } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.544943 26343 raft_consensus.cc:2932] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.548451 25515 raft_consensus.cc:2932] T b90778aac3294e6c913dfe12245b17e1 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.548336 25437 raft_consensus.cc:2932] T b90778aac3294e6c913dfe12245b17e1 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.551828 25336 catalog_manager.cc:5484] T b90778aac3294e6c913dfe12245b17e1 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:38.552601 25590 consensus_queue.cc:237] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } }
I20240502 01:55:38.557602 25437 raft_consensus.cc:1261] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:55:38.557649 25515 raft_consensus.cc:1261] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Refusing update from remote peer a7ffa3e1ba614911a5fc9fafc38573f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 01:55:38.557729 25556 consensus_peers.cc:485] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 -> Peer e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4:45835): Couldn't send request to peer e6f4ddf520ea4341adafe59ace70e6dc. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c9855b1e8274e49a57434e6151b8e70. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:55:38.558053 26260 consensus_queue.cc:1035] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:38.558327 26341 consensus_queue.cc:1035] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:55:38.561223 26260 raft_consensus.cc:2932] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.561861 25512 raft_consensus.cc:2932] T 3c9855b1e8274e49a57434e6151b8e70 P 77c36b03bf7c42a9a430cc595953aff9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.566902 25337 catalog_manager.cc:5484] T 3c9855b1e8274e49a57434e6151b8e70 P a7ffa3e1ba614911a5fc9fafc38573f1 reported cstate change: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New cstate: current_term: 1 leader_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:55:38.573163 25437 raft_consensus.cc:2932] T 3c9855b1e8274e49a57434e6151b8e70 P 481341cc6302403dab5dcc402f42a81f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e6f4ddf520ea4341adafe59ace70e6dc (127.23.192.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "481341cc6302403dab5dcc402f42a81f" member_type: VOTER last_known_addr { host: "127.23.192.1" port: 39851 } attrs { replace: true } } peers { permanent_uuid: "77c36b03bf7c42a9a430cc595953aff9" member_type: VOTER last_known_addr { host: "127.23.192.2" port: 37163 } } peers { permanent_uuid: "a7ffa3e1ba614911a5fc9fafc38573f1" member_type: VOTER last_known_addr { host: "127.23.192.3" port: 36291 } } peers { permanent_uuid: "e6f4ddf520ea4341adafe59ace70e6dc" member_type: NON_VOTER last_known_addr { host: "127.23.192.4" port: 45835 } attrs { promote: true } } }
I20240502 01:55:38.959652 26360 ts_tablet_manager.cc:902] T 325a9997b7724b7a999511469e0cf9da P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer 77c36b03bf7c42a9a430cc595953aff9 (127.23.192.2:37163)
F20240502 01:55:38.960059 26360 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (init.queue_time_us, init.queue_time_us) (init.run_cpu_time_us, init.run_cpu_time_us) (init.run_wall_time_us, init.run_wall_time_us) (leader-initialization.queue_time_us, leader-initialization.queue_time_us) (leader-initialization.run_cpu_time_us, leader-initialization.run_cpu_time_us) (leader-initialization.run_wall_time_us, leader-initialization.run_wall_time_us) (log-alloc.queue_time_us, log-alloc.queue_time_us) (log-alloc.run_cpu_time_us, log-alloc.run_cpu_time_us) (log-alloc.run_wall_time_us, log-alloc.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-03251bf1c560469880b1ab407d24a810.queue_time_us, tablet-download-pool-03251bf1c560469880b1ab407d24a810.queue_time_us) (tablet-download-pool-03251bf1c560469880b1ab407d24a810.run_cpu_time_us, tablet-download-pool-03251bf1c560469880b1ab407d24a810.run_cpu_time_us) (tablet-download-pool-03251bf1c560469880b1ab407d24a810.run_wall_time_us, tablet-download-pool-03251bf1c560469880b1ab407d24a810.run_wall_time_us) (tablet-download-pool-1721db9e2cf341f98bad0f77824788ff.queue_time_us, tablet-download-pool-1721db9e2cf341f98bad0f77824788ff.queue_time_us) (tablet-download-pool-1721db9e2cf341f98bad0f77824788ff.run_cpu_time_us, tablet-download-pool-1721db9e2cf341f98bad0f77824788ff.run_cpu_time_us) (tablet-download-pool-1721db9e2cf341f98bad0f77824788ff.run_wall_time_us, tablet-download-pool-1721db9e2cf341f98bad0f77824788ff.run_wall_time_us) (tablet-download-pool-1f53a683b23346ae963d62ef4c84bee8.queue_time_us, tablet-download-pool-1f53a683b23346ae963d62ef4c84bee8.queue_time_us) (tablet-download-pool-1f53a683b23346ae963d62ef4c84bee8.run_cpu_time_us, tablet-download-pool-1f53a683b23346ae963d62ef4c84bee8.run_cpu_time_us) (tablet-download-pool-1f53a683b23346ae963d62ef4c84bee8.run_wall_time_us, tablet-download-pool-1f53a683b23346ae963d62ef4c84bee8.run_wall_time_us) (tablet-download-pool-28f04f974e1b420f904c63cf6e1baa6b.queue_time_us, tablet-download-pool-28f04f974e1b420f904c63cf6e1baa6b.queue_time_us) (tablet-download-pool-28f04f974e1b420f904c63cf6e1baa6b.run_cpu_time_us, tablet-download-pool-28f04f974e1b420f904c63cf6e1baa6b.run_cpu_time_us) (tablet-download-pool-28f04f974e1b420f904c63cf6e1baa6b.run_wall_time_us, tablet-download-pool-28f04f974e1b420f904c63cf6e1baa6b.run_wall_time_us) (tablet-download-pool-2f6789c3e6d44cff8e50f6a9af1a42e7.queue_time_us, tablet-download-pool-2f6789c3e6d44cff8e50f6a9af1a42e7.queue_time_us) (tablet-download-pool-2f6789c3e6d44cff8e50f6a9af1a42e7.run_cpu_time_us, tablet-download-pool-2f6789c3e6d44cff8e50f6a9af1a42e7.run_cpu_time_us) (tablet-download-pool-2f6789c3e6d44cff8e50f6a9af1a42e7.run_wall_time_us, tablet-download-pool-2f6789c3e6d44cff8e50f6a9af1a42e7.run_wall_time_us) (tablet-download-pool-325a9997b7724b7a999511469e0cf9da.queue_time_us, tablet-download-pool-325a9997b7724b7a999511469e0cf9da.queue_time_us) (tablet-download-pool-4ddecb61ec374e229ae91cda1bfbd6c5.queue_time_us, tablet-download-pool-4ddecb61ec374e229ae91cda1bfbd6c5.queue_time_us) (tablet-download-pool-4ddecb61ec374e229ae91cda1bfbd6c5.run_cpu_time_us, tablet-download-pool-4ddecb61ec374e229ae91cda1bfbd6c5.run_cpu_time_us) (tablet-download-pool-4ddecb61ec374e229ae91cda1bfbd6c5.run_wall_time_us, tablet-download-pool-4ddecb61ec374e229ae91cda1bfbd6c5.run_wall_time_us) (tablet-download-pool-568a8db50f33400992fff1ff0b3f9505.queue_time_us, tablet-download-pool-568a8db50f33400992fff1ff0b3f9505.queue_time_us) (tablet-download-pool-568a8db50f33400992fff1ff0b3f9505.run_cpu_time_us, tablet-download-pool-568a8db50f33400992fff1ff0b3f9505.run_cpu_time_us) (tablet-download-pool-568a8db50f33400992fff1ff0b3f9505.run_wall_time_us, tablet-download-pool-568a8db50f33400992fff1ff0b3f9505.run_wall_time_us) (tablet-download-pool-5b64e37777a0493aa438b49a92d9f4fd.queue_time_us, tablet-download-pool-5b64e37777a0493aa438b49a92d9f4fd.queue_time_us) (tablet-download-pool-5b64e37777a0493aa438b49a92d9f4fd.run_cpu_time_us, tablet-download-pool-5b64e37777a0493aa438b49a92d9f4fd.run_cpu_time_us) (tablet-download-pool-5b64e37777a0493aa438b49a92d9f4fd.run_wall_time_us, tablet-download-pool-5b64e37777a0493aa438b49a92d9f4fd.run_wall_time_us) (tablet-download-pool-6bc6480138d14df397ca2db53ca652d2.queue_time_us, tablet-download-pool-6bc6480138d14df397ca2db53ca652d2.queue_time_us) (tablet-download-pool-6bc6480138d14df397ca2db53ca652d2.run_cpu_time_us, tablet-download-pool-6bc6480138d14df397ca2db53ca652d2.run_cpu_time_us) (tablet-download-pool-6bc6480138d14df397ca2db53ca652d2.run_wall_time_us, tablet-download-pool-6bc6480138d14df397ca2db53ca652d2.run_wall_time_us) (tablet-download-pool-71689056867841e3aef8030fe4d2c58b.queue_time_us, tablet-download-pool-71689056867841e3aef8030fe4d2c58b.queue_time_us) (tablet-download-pool-71689056867841e3aef8030fe4d2c58b.run_cpu_time_us, tablet-download-pool-71689056867841e3aef8030fe4d2c58b.run_cpu_time_us) (tablet-download-pool-71689056867841e3aef8030fe4d2c58b.run_wall_time_us, tablet-download-pool-71689056867841e3aef8030fe4d2c58b.run_wall_time_us) (tablet-download-pool-8824314ff50341f4ac45b9d16bc2e338.queue_time_us, tablet-download-pool-8824314ff50341f4ac45b9d16bc2e338.queue_time_us) (tablet-download-pool-8824314ff50341f4ac45b9d16bc2e338.run_cpu_time_us, tablet-download-pool-8824314ff50341f4ac45b9d16bc2e338.run_cpu_time_us) (tablet-download-pool-8824314ff50341f4ac45b9d16bc2e338.run_wall_time_us, tablet-download-pool-8824314ff50341f4ac45b9d16bc2e338.run_wall_time_us) (tablet-download-pool-de09870b6fba4a19bf37028fea65f5bd.queue_time_us, tablet-download-pool-de09870b6fba4a19bf37028fea65f5bd.queue_time_us) (tablet-download-pool-de09870b6fba4a19bf37028fea65f5bd.run_cpu_time_us, tablet-download-pool-de09870b6fba4a19bf37028fea65f5bd.run_cpu_time_us) (tablet-download-pool-de09870b6fba4a19bf37028fea65f5bd.run_wall_time_us, tablet-download-pool-de09870b6fba4a19bf37028fea65f5bd.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us) (wal-append.queue_time_us, wal-append.queue_time_us) (wal-append.run_cpu_time_us, wal-append.run_cpu_time_us) (wal-append.run_wall_time_us, wal-append.run_wall_time_us)
*** Check failure stack trace: ***
*** Aborted at 1714614938 (unix time) try "date -d @1714614938" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800005f00) received by PID 24320 (TID 0x7f6cae0d0700) from PID 24320; stack trace: ***
@ 0x7f6ce5432980 (unknown) at ??:0
@ 0x7f6cda77ffb7 gsignal at ??:0
@ 0x7f6cda781921 abort at ??:0
@ 0x7f6cdd234dcd google::LogMessage::Fail() at ??:0
@ 0x7f6cdd238b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f6cdd2347cc google::LogMessage::Flush() at ??:0
@ 0x7f6cdd235f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20240502 01:55:38.986789 26361 ts_tablet_manager.cc:902] T 9fa192ac75ca4897be4bed9594502e7b P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
@ 0x7f6cde8b1742 kudu::TraceMetrics::InternName() at ??:0
@ 0x7f6cde87df8b kudu::ThreadPool::ThreadPool() at ??:0
@ 0x7f6cde877cd6 kudu::ThreadPoolBuilder::Build() at ??:0
@ 0x7f6cedd438de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
@ 0x7f6cedd5bdaf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7f6cede86480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7f6cedebea8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7f6cedea1981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
I20240502 01:55:39.024138 26368 ts_tablet_manager.cc:902] T 3c9855b1e8274e49a57434e6151b8e70 P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
@ 0x7f6cedea170e std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f6cf2d4398d std::function<>::operator()() at ??:0
@ 0x7f6cde881b75 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6cde88519c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f6cde885019 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f6cf2d4398d std::function<>::operator()() at ??:0
@ 0x7f6cde86001e kudu::Thread::SuperviseThread() at ??:0
I20240502 01:55:39.055481 26377 ts_tablet_manager.cc:902] T b90778aac3294e6c913dfe12245b17e1 P e6f4ddf520ea4341adafe59ace70e6dc: Initiating tablet copy from peer a7ffa3e1ba614911a5fc9fafc38573f1 (127.23.192.3:36291)
@ 0x7f6ce54276db start_thread at ??:0
@ 0x7f6cda86271f clone at ??:0